- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation workflows using Azure Databricks (ADB) and PySpark/Spark SQL.
- Integrate data from multiple structured and unstructured sources into Azure Data Lake / Synapse.
- Monitor, troubleshoot, and tune pipeline performance for reliability and cost efficiency.
- Implement data quality checks, logging, and error-handling frameworks within pipelines.
- Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical solutions.
- Ensure adherence to data security, governance, and compliance standards.
Required Skills & Experience
- 10+years of hands-on experience in data engineering, with strong expertise in Azure Data Factory and Azure Databricks.
- Proficiency in SQL, Python, and/or Scala for data transformation.
- Solid understanding of data warehousing concepts, data modeling, and pipeline orchestration.
- Experience with Azure Data Lake Storage, Synapse Analytics, or similar cloud data platforms.
- Strong analytical and problem-solving skills with attention to detail.
- Good communication skills and ability to work in a client-facing environment.
Valuable to Have
Experience with CI/CD for data pipelines, Azure DevOps, and knowledge of Delta Lake.
📌 Azure Data Engineer (Chennai)
🏢 Tata Consultancy Services
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.