22 Sep
|
XpertNest
|
India
Job DescriptionSenior Data Engineer – Databricks
nExperience: 6+ years (robust hands-on Databricks experience)
nLocation: Ahmedabad preferred (open to candidates from other locations)
nWork Mode: Hybrid
nJoining: Immediate joiners only
nAbout the Role
nWe are looking for a Senior Data Engineer with robust expertise in Databricks. You will build and manage data pipelines on Databricks and Microsoft Azure, making sure data is clean, reliable and ready for reporting and analytics.
nKey Responsibilities
n
n
Design, build and maintain data pipelines on Databricks using PySpark and SQLn
Work with Delta Lake and organise data into Bronze, Silver and Gold layersn
Handle both batch and streaming (real-time) data loadsn
Build and schedule pipelines using Azure Data Factory and Databricks Workflowsn
Bring in data from different sources such as databases, files and APIsn
Improve pipeline performance and keep Databricks costs under controln
Manage data access and security using Unity Catalogn
Work with analysts and business teams, and guide junior engineersn
nMust-Have Skills
n
n
Databricks – solid hands-on experience (Delta Lake, Workflows, Unity Catalog, performance tuning)n
PySpark and SQLn
Azure Data Factoryn
Azure Data Lake (ADLS) and Blob Storagen
Data modelling, data warehousing and ETL / ELTn
Git and basic CI/CDn
nGood to Have
n
n
Azure Synapse, Microsoft Fabric or Power BIn
Basic exposure to AI / GenAI or AI coding assistants (e.g. GitHub Copilot)n
Kafka or other streaming toolsn
Databricks or Microsoft data engineering certificationn
📌 Senior Data Engineer Sabarmati River (India)
🏢 XpertNest
📍 India