Senior Data Engineer – Databricks

n

nExperience: 6+ years (strong hands-on Databricks experience)

nLocation: Ahmedabad preferred (open to candidates from other locations)

nWork Mode: Hybrid

nJoining: Immediate joiners only

n

nAbout the Role

nWe are looking for a Senior Data Engineer with strong expertise in Databricks. You will build and manage data pipelines on Databricks and Microsoft Azure, making sure data is clean, reliable and ready for reporting and analytics.

n

nKey Responsibilities

n- Design, build and maintain data pipelines on Databricks using PySpark and SQL

n- Work with Delta Lake and organise data into Bronze, Silver and Gold layers

n- Handle both batch and streaming (real-time) data loads

n- Build and schedule pipelines using Azure Data Factory and Databricks Workflows

n- Bring in data from different sources such as databases, files and APIs





n- Improve pipeline performance and keep Databricks costs under control

n- Manage data access and security using Unity Catalog

n- Work with analysts and business teams, and guide junior engineers

n

nMust-Have Skills

n- Databricks – solid hands-on experience (Delta Lake, Workflows, Unity Catalog, performance tuning)

n- PySpark and SQL

n- Azure Data Factory

n- Azure Data Lake (ADLS) and Blob Storage

n- Data modelling, data warehousing and ETL / ELT

n- Git and basic CI/CD

n

nGood to Have

n- Azure Synapse, Microsoft Fabric or Power BI

n- Basic exposure to AI / GenAI or AI coding assistants (e.g. GitHub Copilot)

n- Kafka or other streaming tools

n- Databricks or Microsoft data engineering certification

📌 Senior Data Engineer - Databricks | Azure Data Factory (India)
🏢 XpertNest
📍 India