Job Description:
Job purpose

Design, construct, and maintain scalable data management systems using Azure Databricks, ensuring to meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Create data processing pipelines utilizing Databricks Notebooks, Spark SQL, Python and other Databricks tools. Oversee and lead the module through planning, estimation, implementation, monitoring and tracking.

Key responsibilities
Interpret business requirements and collaborate with internal teams and vendors
Design, develop, and maintain Databricks solutions and data quality rules
Analyze data from multiple sources and troubleshoot data-related issues
Develop and optimize PySpark, Python, and SQL code to improve performance
Build and configure data models, system settings, and database solutions (SQL Server, Oracle)
Maintain existing code, ensure quality standards, and meet SLA/TAT commitments
Conduct testing (unit/integration), document processes, and provide user training




Identify improvement prospects and contribute to problem-solving initiatives
Communicate effectively with stakeholders and deliver within tight timelines
Work independently, multitask efficiently, and maintain high attention to detail

Key competencies

Required Skills:
Azure Data Engineering: Proven success as an Azure Data Engineer, with the ability to consult, advise,

engineer and optimise our customers data products and assets
Semantic Models: Proven experience in designing and implementing semantic models to ensure data is easily

understandable and usable by business users
Medallion Architecture Expertise: Deep understanding and hands-on experience with the medallion

architecture, including the ability to design and implement bronze, silver, and gold data layers
Azure Data Products: Expertise in one or more of the following platforms: Microsoft Fabric, Azure Synapse

Analytics and Azure Databricks,

📌 Databricks Data Engineer Gurugram
🏢 Acuity Knowledge Partners
📍 Gurugram