Role: Azure Data Engineer Lead

Experience: 8–10 Years

Location: Chennai, Bangalore

Key Skills: Azure Data Engineering, Azure Databricks, Azure Data Factory, PySpark, SQL

About The Role

We are looking for a hands-on Azure Data Engineer Lead to architect, build, and scale enterprise-grade data platforms on Microsoft Azure. You will lead a team of data engineers, define best practices, and partner with architects, analysts, and business stakeholders to turn raw data into reliable, high-performance pipelines that power analytics, reporting, and AI initiatives.

Key Responsibilities

- Lead the design, development, and optimization of scalable data pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics
- Architect modern data lakehouse solutions using ADLS Gen2, Delta Lake, and Synapse/Fabric
- Define and enforce data engineering standards, coding guidelines, and CI/CD practices across the team
- Own end-to-end data architecture — ingestion, transformation, orchestration, and governance
- Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable technical solutions
- Optimize pipeline performance, cost, and reliability across large-scale distributed datasets
- Implement robust data quality, security, lineage, and monitoring frameworks (Purview, Key Vault, Log Analytics)
- Mentor and guide a team of data engineers; conduct code reviews and technical design sessions




- Drive cloud cost optimization and adherence to Azure Well-Architected Framework principles
- Stay current with emerging Azure data services and evaluate their adoption

Required Skills

- Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2
- Proficiency in PySpark, SQL, and Python for large-scale data processing
- Experience with Delta Lake / Lakehouse architecture
- Robust understanding of data modeling (dimensional, star/snowflake schema)
- Experience with CI/CD pipelines (Azure DevOps) and Infrastructure-as-Code (Terraform/ARM/Bicep)
- Solid grasp of data governance, security, and compliance (RBAC, Azure Purview, encryption)
- Experience leading teams and managing project delivery in an Agile environment
- Strong communication and stakeholder management skills

Good To Have

- Experience with Microsoft Fabric / Power BI
- Exposure to Azure Event Hub / Stream Analytics for real-time processing
- Knowledge of MLOps or integration with Azure Machine Learning
- Microsoft certifications: DP-203 (Azure Data Engineer Associate), Azure Solutions Architect

Why Join Us?

- Work on cutting-edge cloud data platforms at enterprise scale
- Lead a talented team and shape data engineering practices from the ground up
- Competitive compensation, flexible work model, and continuous learning opportunities

Skills: azure data factory,sql,pyspark,azure databricks,azure data engineer,azure data engineering

📌 Azure Data Engineer Lead (Chennai)
🏢 Softview Infotech
📍 Chennai