Job Description

We are looking for a Lead Azure Databricks Data Engineer to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure. The ideal candidate should have robust hands-on experience with Azure Databricks, Spark/PySpark, Azure Data Factory, and Azure Data Lake, along with expertise in building scalable data pipelines, data models, and modern Lakehouse architectures.

The role involves working closely with business stakeholders, leading technical discussions, mentoring engineering teams, and delivering high-performance, production-grade data solutions.

Key Responsibilities

- Design and build scalable data platforms using Azure Databricks.
- Develop and optimize ETL/ELT pipelines using PySpark and Azure Data Factory.
- Design Data Lake, Data Warehouse and Data Mesh solutions.
- Optimize Spark jobs for performance and cost.
- Build robust CI/CD pipelines using Azure DevOps/GitHub/Terraform.
- Implement Unity Catalog, data governance and security best practices.
- Design data models for analytics and reporting.
- Collaborate with cross-functional teams and mentor junior engineers.

📌 Lead Databricks Data Engineer (India)
🏢 Adastra
📍 India