22 Aug
|
Acuity Knowledge Partners
|
Gurugram
22 Aug
Acuity Knowledge Partners
Gurugram
Job Description:
Job purpose
Design, construct, and maintain scalable data management systems using Azure Databricks, ensuring to meet end-user expectations. Supervise the upkeep of existing data infrastructure workflows to ensure continuous service delivery. Create data processing pipelines utilizing Databricks Notebooks, Spark SQL, Python and other Databricks tools. Oversee and lead the module through planning, estimation, implementation, monitoring and tracking.
Key responsibilities
- Interpret business requirements and collaborate with internal teams and vendors
- Design, develop, and maintain Databricks solutions and data quality rules
- Analyze data from multiple sources and troubleshoot data-related issues
- Develop and optimize PySpark, Python, and SQL code to improve performance
- Build and configure data models, system settings, and database solutions (SQL Server, Oracle)
- Maintain existing code, ensure quality standards, and meet SLA/TAT commitments
- Conduct testing (unit/integration), document processes, and provide user training
- Identify improvement opportunities and contribute to problem-solving initiatives
- Communicate effectively with stakeholders and deliver within tight timelines
- Work independently, multitask efficiently, and maintain high attention to detail
Key competencies
Required Skills:
- Azure Data Engineering: Proven success as an Azure Data Engineer, with the ability to consult, advise,
engineer and optimise our customers data products and assets
- Semantic Models: Proven experience in designing and implementing semantic models to ensure data is easily
understandable and usable by business users
- Medallion Architecture Expertise: Deep understanding and hands-on experience with the medallion
architecture, including the ability to design and implement bronze, silver, and gold data layers
- Azure Data Products: Expertise in one or more of the following platforms: Microsoft Fabric, Azure Synapse
Analytics and Azure Databricks,
📌 Databricks Data Engineer (Gurugram)
🏢 Acuity Knowledge Partners
📍 Gurugram