Job purpose

Design, construct, and maintain scalable data management systems using Azure Databricks, ensuring to meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Create data processing pipelines utilizing Databricks Notebooks, Spark SQL, Python and other Databricks tools. Oversee and lead the module through planning, estimation, implementation, monitoring and tracking.

Key responsibilities

Interpret business requirements and collaborate with internal teams and vendors

Design, develop, and maintain Databricks solutions and data quality rules

Analyze data from multiple sources and troubleshoot data-related issues

Develop and optimize PySpark, Python, and SQL code to improve performance

Build and configure data models, system settings, and database solutions (SQL Server, Oracle)

Maintain existing code, ensure quality standards, and meet SLA/TAT commitments

Conduct testing (unit/integration), document processes, and provide user training

Identify improvement opportunities and contribute to problem-solving initiatives

Communicate effectively with stakeholders and deliver within tight timelines

Work independently, multitask efficiently, and maintain high attention to detail

Key competencies

Required Skills

Azure Data Engineering: Proven success as an Azure Data Engineer, with the ability to consult, advise,

engineer and optimise our customers data products and assets

Semantic Models:



Proven experience in designing and implementing semantic models to ensure data is easily

understandable and usable by business users

Medallion Architecture Expertise: Deep understanding and hands-on experience with the medallion

architecture, including the ability to design and implement bronze, silver, and gold data layers

Azure Data Products: Expertise in one or more of the following platforms: Microsoft Fabric, Azure Synapse

Analytics and Azure Databricks, and experience in some of the supporting data technologies like Power BI,

Microsoft Purview, Azure SQL Database, Azure Cosmos DB, Azure Data Lake, etc.Microsoft Fabric is

preferred as experience along with Azure Synapse and/or Azure Databricks.

Azure: Understand core Azure infrastructure concepts and tools (Networks, Identify/Entra,

ARM, BICEP, Terraform, etc). You dont need to be an expert in these but need to understand where they fit into the picture.

DevOps: Experience with CI/CD promotion from Dev to Prod, through tools like Fabric, Azure DevOps and/or GitHub.

Exceptional Communication: Solid verbal, written, and presentation skills to both internal and external audiences.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Databricks Data Engineer - Lead Engineer (Gurugram)
🏢 Moodys Analytics
📍 Gurugram