We are hiring an experienced Azure Databricks Engineer to design, build, and optimize modern data platforms covering real-time streaming, Delta Lake architecture, and Generative AI-driven analytics. The role requires end-to-end ownership of data engineering deliverables, from pipeline development to production support, while collaborating closely with business and analytics stakeholders.
Key Skills
Azure Databricks | Delta Lake | Delta Table Streaming | PySpark | Unity Catalog | Medallion Architecture | Azure Data Factory | Gen AI (LLM, RAG)
Must-Have Skills
- Strong hands-on Databricks expertise — PySpark/SQL, Workflows/Jobs orchestration, Delta Lake, Unity Catalog
- Working knowledge of Azure Data Factory
- Experience with Lakeflow (Declarative Pipelines/Connect)
including CDC and data quality validations
- Exposure to Databricks AI/BI or Genie (semantic layers, certified datasets)
- Familiarity with CI/CD and version control (Git, Databricks Repos/Asset Bundles)
- Demonstrated ability to own deliverables fully and resolve issues independently
- Solid communication skills for working with business/analytics stakeholders
Eligibility
- 5–10 years of relevant data engineering experience
- Valid passport with minimum 1 year validity is mandatory
- Willingness to be based at any of the listed locations