TCS Hiring for Azure Databricks, ADF, Pyspark, Python, Terraform
Experience Range: - 06 To 10 Years (Mandatory)
(Note: Candidates below 06 years of IT experience shall not be considered)
JOB LOCATION: Chennai
JOB DESCRIPTION
Key Responsibilities:
Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks. Build and optimize large-scale ETL/ELT processes using Py Spark and Python. Ingest data from various structured and unstructured sources into Azure Data Lake. Develop batch and real-time data processing solutions. Create reusable data transformation frameworks and data quality checks. Implement Infrastructure as Code (Ia C) using Terraform. Manage Azure resources including Data Lake Storage, Key Vault, Databricks, ADF, and Monitoring services. Optimize Spark jobs for performance, scalability, and cost efficiency. Develop CI/CD pipelines for deployment automation. Collaborate with business stakeholders, architects, and development teams to define data requirements and solutions.



Support production deployments and troubleshoot data pipeline issues. Follow data governance, security, and compliance standards. Required Technical Skills:
Azure Services: Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Azure Dev Ops Data Engineering: Solid expertise in ETL/ELT development, Data Warehousing concepts, Data Modeling (Star Schema, Snowflake Schema). Batch and Streaming Data Processing Programming: Python, Py Spark, SQL Infrastructure as Code: Terraform, Azure Resource Management Concepts Databases: Azure SQL Database, SQL Server, Postgre SQL, Cosmos DB (Preferred) 6)Dev Ops: Azure Dev Ops, Git, CI/CD Pipeline Implementation
Mandatory Skills:
Azure Databricks Azure Data Factory (ADF) Py Spark Python Terraform SQL Azure Data Lake Storage (ADLS) Azure Dev Ops Preferred Skills:
Delta Lake Unity Catalog Spark Optimization Data Governance Real-time Streaming (Kafka/Event Hub) Synapse Analy

📌 Azure databricks, adf, pyspark, python, terraform (Chennai)
🏢 Tata Consultancy Services
📍 Chennai