Senior Data Engineer – Databricks

Experience: 6+ years (strong hands-on Databricks experience)

Location: Ahmedabad preferred (open to candidates from other locations)

Work Mode: Hybrid

Joining: Immediate joiners only

About the Role

We are looking for a Senior Data Engineer with robust expertise in Databricks. You will build and manage data pipelines on Databricks and Microsoft Azure, making sure data is clean, reliable and ready for reporting and analytics.

Key Responsibilities
Design, build and maintain data pipelines on Databricks using PySpark and SQL
Work with Delta Lake and organise data into Bronze, Silver and Gold layers
Handle both batch and streaming (real-time) data loads
Build and schedule pipelines using Azure Data Factory and Databricks Workflows
Bring in data from different sources such as databases, files and APIs




Improve pipeline performance and keep Databricks costs under control
Manage data access and security using Unity Catalog
Work with analysts and business teams, and guide junior engineers

Must-Have Skills
Databricks – solid hands-on experience (Delta Lake, Workflows, Unity Catalog, performance tuning)
PySpark and SQL
Azure Data Factory
Azure Data Lake (ADLS) and Blob Storage
Data modelling, data warehousing and ETL / ELT
Git and basic CI/CD

Valuable to Have
Azure Synapse, Microsoft Fabric or Power BI
Basic exposure to AI / GenAI or AI coding assistants (e.g. GitHub Copilot)
Kafka or other streaming tools
Databricks or Microsoft data engineering certification

📌 Senior Data Engineer – Databricks Azure Data Factory Ahmedabad
🏢 XpertNest
📍 Ahmedabad