Job Description

TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform

/n

Experience Range: - 06 To 10 Years (Mandatory)

/n

(Note: Candidates below 06 years of IT experience shall not be considered)

/n

JOB LOCATION: Chennai

/n

JOB DESCRIPTION

/n

Key Responsibilities:

/n

/n
Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks.
/n
Build and optimize large-scale ETL/ELT processes using PySpark and Python.
/n
Ingest data from various structured and unstructured sources into Azure Data Lake.
/n
Develop batch and real-time data processing solutions.
/n
Create reusable data transformation frameworks and data quality checks.
/n
Implement Infrastructure as Code (IaC) using Terraform.
/n
Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services.
/n
Optimize Spark jobs for performance, scalability, and cost efficiency.
/n
Develop CI/CD pipelines for deployment automation.
/n
Collaborate with business stakeholders, architects,



and development teams to define data requirements and solutions.
/n
Support production deployments and troubleshoot data pipeline issues.
/n
Follow data governance, security, and compliance standards.
/n

/n

Required Technical Skills:

/n

/n
Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure DevOps
/n
Data Engineering: Solid expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing
/n
Programming: Python, PySpark, SQL
/n
Infrastructure as Code: Terraform, Azure Resource Management Concepts
/n
Databases: Azure SQL Database, SQL Server, PostgreSQL, Cosmos DB (Preferred)
/n

/n

6)DevOps: Azure DevOps, Git, CI/CD Pipeline Implementation

/n

Mandatory Skills:

/n

/n
Azure Databricks
/n
Azure Data Factory (ADF)
/n
PySpark
/n
Python
/n
Terrafor

📌 Azure Databricks, Adf, Pyspark, Python, Terraform Coimbatore (India)
🏢 Tata Consultancy Services
📍 India