Role: Azure Data Engineer Lead

Experience: 8–10 Years

Location: Chennai, Bangalore

Key Skills: Azure Data Engineering, Azure Databricks, Azure Data Factory, PySpark, SQL

About The Role

We are looking for a hands-on Azure Data Engineer Lead to architect, build, and scale enterprise-grade data platforms on Microsoft Azure. You will lead a team of data engineers, define best practices, and partner with architects, analysts, and business stakeholders to turn raw data into reliable, high-performance pipelines that power analytics, reporting, and AI initiatives.

Key Responsibilities

Lead the design, development, and optimization of scalable data pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics
Architect modern data lakehouse solutions using ADLS Gen2, Delta Lake, and Synapse/Fabric
Define and enforce data engineering standards, coding guidelines, and CI/CD practices across the team
Own end-to-end data architecture — ingestion, transformation, orchestration, and governance
Collaborate with data architects, BI teams,



and business stakeholders to translate requirements into scalable technical solutions
Optimize pipeline performance, cost, and reliability across large-scale distributed datasets
Implement robust data quality, security, lineage, and monitoring frameworks (Purview, Key Vault, Log Analytics)
Mentor and guide a team of data engineers; conduct code reviews and technical design sessions
Drive cloud cost optimization and adherence to Azure Well-Architected Framework principles
Stay current with emerging Azure data services and evaluate their adoption

Required Skills

Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2
Proficiency in PySpark, SQL, and Python for large-scale data processing
Experience with Delta Lake / Lakehouse architecture
Robust understanding of data modeling (dimensional, star/snowflake schema)
Experience with CI/CD pipelines (Azure DevOps) and Infrastructure-as-Co

📌 Azure Data Engineer Lead (Chennai)
🏢 Softview Infotech
📍 Chennai