01 Oct
|
Tata Consultancy Services
|
Bengaluru
01 Oct
Tata Consultancy Services
Bengaluru
Lead Azure Data Engineer
Role: Lead Azure Data Engineer
Experience: 15-20 Years
Location: Bangalore / Chennai / Hyderabad / Mumbai / Pune
Notice Period: 0-30 Days
Employment Type: Full time
About the Role
We are seeking a highly experienced Lead Azure Data Engineer to drive the design, development, and modernization of enterprise-scale data platforms on Microsoft Azure. The ideal candidate will possess deep expertise in Azure-native data technologies, modern data architectures, and large-scale cloud transformation initiatives.
This role requires a strong technical leader who can architect scalable data solutions, mentor engineering teams, collaborate with stakeholders, and deliver business-critical data platforms that support analytics, reporting, and data-driven decision-making. [EP-JD_Azur...gineer ING | Word]
Key Responsibilities
- Lead the end-to-end design and implementation of modern Azure Data Platforms.
- Architect and develop scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data processing frameworks using Azure Databricks, PySpark, and Spark SQL.
- Design and implement Lakehouse / Medallion Architecture leveraging ADLS Gen2 and Delta Lake.
- Develop enterprise-grade data models and analytics solutions using Azure Synapse Analytics and Azure SQL.
- Drive data ingestion, transformation, orchestration, and performance optimization initiatives.
- Establish best practices around data governance, security, compliance, and operational excellence.
- Collaborate with business stakeholders, architects, product owners,
and analytics teams to deliver high-value solutions.
- Mentor and guide Data Engineers while providing technical leadership across multiple projects.
- Implement DevOps, CI/CD, automation, and monitoring frameworks for data engineering solutions.
Mandatory Skills
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage Gen2 (ADLS Gen2)
- PySpark
- Spark SQL
- Azure SQL Database / Azure SQL Data Warehouse
- Delta Lake
- Data Warehousing Concepts
- ETL / ELT Design & Development
- Azure DevOps / CI-CD
- SQL / T-SQL
Preferred Skills
- Snowflake
- Power BI
- Azure Key Vault
- Azure Event Hub
- Azure Stream Analytics
- RBAC & Data Governance
- Lakehouse Architecture
- Data Quality Frameworks
- Metadata-Driven Data Pipelines
Leadership Expectations
- Lead and mentor teams of Data Engineers.
- Drive solution architecture discussions and technical decision-making.
- Engage with business and technology stakeholders.
- Support delivery planning, estimation, risk management, and technical governance.
- Ensure adherence to enterprise architecture and engineering standards.
Candidate Profile
- 15+ years of overall IT experience.
- 7+ years of hands-on Azure Data Engineering experience.
- Proven experience delivering enterprise-scale cloud data transformations.
- Strong understanding of modern data architectures and engineering best practices.
- Excellent communication, stakeholder management, and leadership skills.
- Azure certifications such as DP-203 (Azure Data Engineer Associate) are highly preferred.
📌 Lead Azure Data Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru