Job Overview

We are looking for an experienced Lead Azure Data Engineer to lead the design, development, and implementation of scalable data engineering solutions on Microsoft Azure. The ideal candidate should have strong hands-on expertise in Azure data services, data architecture, ETL/ELT pipelines, and cloud data platforms, along with experience leading technical teams and driving data engineering initiatives.

Key Responsibilities

- Lead the design and development of scalable data pipelines and data integration solutions using Azure data services.

- Architect and implement ETL/ELT workflows using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.

- Develop complex data transformations using Python, PySpark, and SQL.

- Design and optimize data lake and lakehouse architectures using Azure Data Lake Storage Gen2 and Delta Lake.

- Establish data modeling, data quality, performance optimization, and data governance standards.

- Implement CI/CD pipelines and deployment processes for data engineering workloads.

- Ensure data security, access control, monitoring, and reliability across Azure environments.

- Lead technical discussions, code reviews, solution design, and troubleshooting activities.





- Mentor senior and junior engineers and coordinate with architects, business teams, and stakeholders.

- Drive best practices in cloud cost optimization, scalability, and data platform performance.

Mandatory Skills

- 12+ years of experience in Data Engineering.

- Strong hands-on experience with Microsoft Azure data services.

- Expertise in Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage Gen2.

- Solid programming skills in Python, PySpark, and SQL.

- Experience with Azure Synapse Analytics or equivalent Azure analytical data platforms.

- Strong understanding of ETL/ELT, dimensional modeling, data warehousing, and distributed data processing.

- Experience designing end-to-end cloud data architecture and leading technical teams.

- Experience with CI/CD, Git, and production data pipeline monitoring.

Good to Have

- Experience with Delta Lake, Azure Event Hubs, and streaming data.

- Knowledge of Microsoft Fabric.

- Experience with Azure DevOps, Terraform, or infrastructure as code.

- Exposure to data governance, metadata management, and data security frameworks.

📌 Lead Azure Data Engineer (Chennai)
🏢 Blackstraw.ai
📍 Chennai