Job Description

TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform

/n

Experience Range: - 06 To 10 Years (Mandatory)

/n

(Note: Candidates below 06 years of IT experience shall not be considered)

/n

JOB LOCATION: Chennai

/n

JOB DESCRIPTION

/n

Key Responsibilities:

/n

/n
- Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.
/n
- Build and optimize large-scale ETL/ELT processes using PySpark and Python.
/n
- Ingest data from various structured and unstructured sources into Azure Data Lake.
/n
- Develop batch and real-time data processing solutions.
/n
- Create reusable data transformation frameworks and data quality checks.
/n
- Implement Infrastructure as Code (IaC) using Terraform.
/n
- Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services.
/n
- Optimize Spark jobs for performance, scalability, and cost efficiency.
/n
- Develop CI/CD pipelines for deployment automation.
/n
- Collaborate with business stakeholders, architects,



and development teams to define data requirements and solutions.
/n
- Support production deployments and troubleshoot data pipeline issues.
/n
- Follow data governance, security, and compliance standards.
/n

/n

Required Technical Skills:

/n

/n
- Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure DevOps
/n
- Data Engineering: Solid expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing
/n
- Programming: Python, PySpark, SQL
/n
- Infrastructure as Code: Terraform, Azure Resource Management Concepts
/n
- Databases: Azure SQL Database, SQL Server, PostgreSQL, Cosmos DB (Preferred)
/n

/n

6)DevOps: Azure DevOps, Git, CI/CD Pipeline Implementation

/n

Mandatory Skills:

/n

/n
- Azure Databricks
/n
- Azure Data Factory (ADF)
/n
- PySpark
/n
- Python
/n
- Terrafor

📌 Azure Databricks, ADF, Pyspark, Python, Terraform (Coimbatore)
🏢 Tata Consultancy Services
📍 Coimbatore