Role: Azure Data Engineer Lead Experience: 8–10 Years Location: Chennai, Bangalore Key Skills: Azure Data Engineering, Azure Databricks, Azure Data Factory, PySpark, SQL About The Role We are looking for a hands-on Azure Data Engineer Lead to architect, build, and scale enterprise-grade data platforms on Microsoft Azure. You will lead a team of data engineers, define best practices, and partner with architects, analysts, and business stakeholders to turn raw data into reliable, high-performance pipelines that power analytics, reporting, and AI initiatives.

Key Responsibilities Lead the design, development, and optimization of scalable data pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics

Architect modern data lakehouse solutions using ADLS Gen2, Delta Lake, and Synapse/Fabric

Define and enforce data engineering standards, coding guidelines, and CI/CD practices across the team

Own end-to-end data architecture — ingestion, transformation, orchestration, and governance

Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable technical solutions

Optimize pipeline performance, cost, and reliability across large-scale distributed datasets

Implement robust data quality, security, lineage, and monitoring frameworks (Purview, Key Vault, Log Analytics)

Mentor and guide a team of data engineers; conduct code reviews and technical design sessions





Drive cloud cost optimization and adherence to Azure Well-Architected Framework principles

Stay current with emerging Azure data services and evaluate their adoption Required Skills Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2

Proficiency in PySpark, SQL, and Python for large-scale data processing

Experience with Delta Lake / Lakehouse architecture

Solid understanding of data modeling (dimensional, star/snowflake schema)

Experience with CI/CD pipelines (Azure DevOps) and Infrastructure-as-Code (Terraform/ARM/Bicep)

Solid grasp of data governance, security, and compliance (RBAC, Azure Purview, encryption)

Experience leading teams and managing project delivery in an Agile environment

Strong communication and stakeholder management skills Good To Have Experience with Microsoft Fabric / Power BI

Exposure to Azure Event Hub / Stream Analytics for real-time processing

Knowledge of MLOps or integration with Azure Machine Learning

Microsoft certifications: DP-203 (Azure Data Engineer Associate), Azure Solutions Architect Why Join Us? Work on cutting-edge cloud data platforms at enterprise scale

Lead a talented team and shape data engineering practices from the ground up

Competitive compensation, flexible work model, and continuous learning opportunities Skills: azure data engineering,azure synapse analytics,sql,azure databricks,azure data engineer,azure data lake,azure data factory,pyspark

📌 Azure Data Engineer Lead (Chennai)
🏢 Softview Infotech
📍 Chennai