Job Requirements

.About the Role

We are seeking a Azure Data Engineer with 6 years of experience to design, build, and optimize enterprise-scale data pipelines and cloud data platforms on Azure. The ideal candidate has deep hands-on expertise across the Azure data stack, robust engineering fundamentals, and the ability to mentor junior engineers while collaborating with architects and business stakeholders on end-to-end data solutions.

Key Responsibilities
Architect, design, and develop robust ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Pipelines
Build and optimize large-scale data processing solutions using PySpark/Scala on Databricks, including performance tuning of Spark jobs
Design and implement data lakehouse architectures using ADLS Gen2, Delta Lake, and Synapse Analytics
Develop dimensional/data models (Star/Snowflake schema) to support enterprise reporting and analytics
Own data quality, governance, lineage, and security (RBAC, encryption, masking, Purview) across the platform
Lead design reviews, define best practices, and mentor mid-level/junior data engineers
Optimize pipeline cost, reliability, and performance; troubleshoot production issues (SLA-driven)
Implement CI/CD pipelines for data workflows using Azure DevOps




Design solutions for real-time/streaming ingestion using Event Hub, Kafka, or Stream Analytics where applicable
Partner with BI teams, data architects, and business stakeholders to translate requirements into scalable data solutions
Contribute to data platform strategy, tool evaluation, and technical roadmap decisions
Prepare technical documentation, architecture diagrams, and runbooks

Required Skills
6 years of overall data engineering experience, with 4 years hands-on in Azure
Expert-level proficiency in Azure Data Factory, Databricks, Synapse Analytics
Robust programming skills in Python/PySpark, SQL, and preferably Scala
Deep experience with ADLS Gen2, Delta Lake, Parquet, and big-data file formats
Solid grasp of data warehousing, dimensional modeling, and data lakehouse patterns
Experience with Azure DevOps/CI-CD for automated pipeline deployment
Robust understanding of data governance, security, and compliance (GDPR, HIPAA, or industry-specific as relevant)
Experience optimizing Spark jobs for cost and performance at scale
Proven experience leading technical design discussions and mentoring junior engineers
Excellent communication skills to work with cross-functional and client-facing teams

📌 Dba + Data Engineer Pune
🏢 Xoriant
📍 Pune