Key Responsibilities
Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
Build and optimize data transformation workflows using Azure Databricks (ADB) and PySpark/Spark SQL.
Integrate data from multiple structured and unstructured sources into Azure Data Lake / Synapse.
Monitor, troubleshoot, and tune pipeline performance for reliability and cost efficiency.
Implement data quality checks, logging, and error-handling frameworks within pipelines.
Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical solutions.
Ensure adherence to data security, governance, and compliance standards.
Required Skills & Experience
10+years of hands-on experience in data engineering, with robust expertise in Azure Data Factory and Azure Databricks.
Proficiency in SQL, Python, and/or Scala for data transformation.
Solid understanding of data warehousing concepts, data modeling, and pipeline orchestration.
Experience with Azure Data Lake Storage, Synapse Analytics, or similar cloud data platforms.
Solid analytical and problem-solving skills with attention to detail.
Good communication skills and ability to work in a client-facing environment.
Positive to Have
Experience with CI/CD for data pipelines, Azure DevOps, and knowledge of Delta Lake.
📌 Azure Data Engineer Chennai (India)
🏢 Tata Consultancy Services
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.