Lead Data Engineer
Location: Pune
Experience: 6+ Years

Role Overvie
wWe are looking for a seasoned Lead Data Engineer with 6+ years of core data engineering experience to design and build scalable, real-time and batch data platforms on Microsoft Azure
.The role requires strong expertise in Azure data services, Python, advanced SQL, complex data transformations, system integrations, and Medallion Architecture

.
Key Responsibiliti
esDesign and build real-time, near-real-time, and batch data ingestion pipelines on Azur
e.Develop Bronze, Silver, and Gold data layers using Medallion Architectur
e.Build complex data transformation, cleansing, enrichment, and reconciliation workflow
s.Integrate data from REST APIs, SFTP, databases, files, enterprise systems, and streaming source
s.Develop event-driven pipelines using Azure Event Hubs and related Azure service
s.Build scalable data processing solutions using Azure Databricks, Apache Spark, and Delta Lak
e.Develop reusable Python and SQL components for ingestion and transformatio
n.Implement schema evolution, incremental loads, retries,



error handling, and data recover
y.Optimize pipeline performance, data storage, partitioning, and query executio
n.Implement data quality checks, monitoring, logging, alerting, and audit control
s.Design data models, schemas, and integration mappings across source and target system
s.Review technical designs and guide data engineers on implementation standard

s.
Required Ski
lls6+ years of hands-on data engineering experien
ce.Strong experience with Microsoft Azure data technologi
es.Hands-on expertise
in:Azure Databri
cksAzure Data Lake Storage G
en2Azure Event H
ubsAzure Data Fact
oryAzure Synapse Analyt
icsDelta L
akeApache Sp
arkStrong Python and PySpark development skil
ls.Advanced SQL skills, including complex joins, window functions, CTEs, and query optimizati
on.Solid experience with real-time and batch ingestion patter
ns.Experience implementing Medallion Architectu
re.Strong und

📌 Lead Data Engineer (Pune)
🏢 ORMAE
📍 Pune