18 Sep
|
XpertNest
|
Junagadh
18 Sep
XpertNest
Junagadh
Remote: Hybrid
Senior Data Engineer – DatabricksExperience: 6+ years (solid hands-on Databricks experience)Location: Ahmedabad preferred (open to candidates from other locations)Work Mode: HybridJoining: Immediate joiners onlyAbout the RoleWe are looking for a Senior Data Engineer with strong expertise in Databricks. You will build and manage data pipelines on Databricks and Microsoft Azure, making sure data is clean, reliable and ready for reporting and analytics.Key ResponsibilitiesDesign, build and maintain data pipelines on Databricks using PySpark and SQLWork with Delta Lake and organise data into Bronze, Silver and Gold layersHandle both batch and streaming (real-time) data loadsBuild and schedule pipelines using Azure Data Factory and Databricks WorkflowsBring in data from different sources such as databases,
files and APIsImprove pipeline performance and keep Databricks costs under controlManage data access and security using Unity CatalogWork with analysts and business teams, and guide junior engineersMust-Have SkillsDatabricks – strong hands-on experience (Delta Lake, Workflows, Unity Catalog, performance tuning)PySpark and SQLAzure Data FactoryAzure Data Lake (ADLS) and Blob StorageData modelling, data warehousing and ETL / ELTGit and basic CI/CDGood to HaveAzure Synapse, Microsoft Fabric or Power BIBasic exposure to AI / GenAI or AI coding assistants (e.g. GitHub Copilot)Kafka or other streaming toolsDatabricks or Microsoft data engineering certification
📌 Senior Data Engineer – Databricks | Azure Data Factory (Junagadh)
🏢 XpertNest
📍 Junagadh