Job Title

Senior Data Engineer – Databricks | PySpark | Azure Data Factory | Logic Apps | Airflow

Experience: 7+ Years
Employment Type: Full time

About the Role

We are seeking a highly skilled Senior Data Engineer to lead cloud data modernization initiatives and build scalable, AI-ready data platforms. The ideal candidate will have deep expertise in Databricks, PySpark, Azure Data Factory (ADF), Azure Logic Apps, and Apache Airflow, with a strong focus on workflow orchestration, pipeline reliability, and enterprise-scale data engineering.

You will be responsible for designing, developing, and optimizing robust data pipelines, implementing modern ETL/ELT architectures, and enabling reliable, high-performance data platforms that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities
- Design, build, and maintain scalable data pipelines using Databricks (PySpark), Azure Data Factory (ADF), Azure Logic Apps, and Apache Airflow.
- Develop and manage end-to-end orchestration frameworks integrating Airflow DAGs, ADF pipelines, and Logic Apps.




- Implement advanced workflow orchestration patterns including event-driven, micro-batch, and hybrid scheduling.
- Ensure pipeline dependency management, execution reliability, fault tolerance, and operational excellence.
- Build high-performance ETL/ELT pipelines leveraging Databricks, PySpark, and Delta Lake architecture.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Implement monitoring, logging, alerting, and data observability across data workflows.
- Integrate pipelines with Azure services including ADLS Gen2, Azure Blob Storage, Event Grid, Event Hubs, and other Azure-native services.
- Develop reusable data engineering frameworks and automation for enterprise-scale data processing.
- Implement CI/CD pipelines for data engineering workflows using GitHub Actions, Azure DevOps, or equivalent tools.
- Ensure data quality through validation, governan

📌 Senior Database Architect – Azure Cloud Migration (Noida)
🏢 UIDM
📍 Noida