Job Requirements

.About the Role

We are seeking a Azure Data Engineer with 6 years of experience to design, build, and optimize enterprise-scale data pipelines and cloud data platforms on Azure. The ideal candidate has deep hands-on expertise across the Azure data stack, strong engineering fundamentals, and the ability to mentor junior engineers while collaborating with architects and business stakeholders on end-to-end data solutions.

Key Responsibilities

- Architect, design, and develop robust ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Pipelines
- Build and optimize large-scale data processing solutions using PySpark/Scala on Databricks, including performance tuning of Spark jobs
- Design and implement data lakehouse architectures using ADLS Gen2, Delta Lake, and Synapse Analytics
- Develop dimensional/data models (Star/Snowflake schema) to support enterprise reporting and analytics
- Own data quality, governance, lineage, and security (RBAC, encryption, masking, Purview) across the platform
- Lead design reviews, define best practices, and mentor mid-level/junior data engineers
- Optimize pipeline cost, reliability, and performance; troubleshoot production issues (SLA-driven)
- Implement CI/CD pipelines for data workflows using Azure DevOps




- Design solutions for real-time/streaming ingestion using Event Hub, Kafka, or Stream Analytics where applicable
- Partner with BI teams, data architects, and business stakeholders to translate requirements into scalable data solutions
- Contribute to data platform strategy, tool evaluation, and technical roadmap decisions
- Prepare technical documentation, architecture diagrams, and runbooks

Required Skills

- 6 years of overall data engineering experience, with 4 years hands-on in Azure
- Expert-level proficiency in Azure Data Factory, Databricks, Synapse Analytics
- Robust programming skills in Python/PySpark, SQL, and preferably Scala
- Deep experience with ADLS Gen2, Delta Lake, Parquet, and big-data file formats
- Solid grasp of data warehousing, dimensional modeling, and data lakehouse patterns
- Experience with Azure DevOps/CI-CD for automated pipeline deployment
- Strong understanding of data governance, security, and compliance (GDPR, HIPAA, or industry-specific as relevant)
- Experience optimizing Spark jobs for cost and performance at scale
- Proven experience leading technical design discussions and mentoring junior engineers
- Excellent communication skills to work with cross-functional and client-facing teams

📌 DBA + Data Engineer (Pune)
🏢 Xoriant
📍 Pune