We are looking for a Lead Azure Databricks Data Engineer to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure. The ideal candidate should have strong hands-on experience with Azure Databricks, Spark/PySpark, Azure Data Factory, and Azure Data Lake, along with expertise in building scalable data pipelines, data models, and contemporary Lakehouse architectures.
The role involves working closely with business stakeholders, leading technical discussions, mentoring engineering teams, and delivering high-performance, production-grade data solutions.
Key Responsibilities
- Design and build scalable data platforms using Azure Databricks.
- Develop and optimize ETL/ELT pipelines using PySpark and Azure Data Factory.
- Design Data Lake, Data Warehouse and Data Mesh solutions.
- Optimize Spark jobs for performance and cost.
- Build robust CI/CD pipelines using Azure DevOps/GitHub/Terraform.
- Implement Unity Catalog, data governance and security best practices.
- Design data models for analytics and reporting.
- Collaborate with cross-functional teams and mentor junior engineers.
📌 Lead Databricks Data Engineer (India)
🏢 Adastra
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.