Roles and Responsibilities :

- Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to integrate various data sources into Azure Databricks.

- Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs.

- Develop complex SQL queries to extract insights from large datasets stored in Azure Blob Storage, ADLS Gen2, and Synapse Analytics.

- Troubleshoot issues related to data pipeline failures or performance problems by analyzing logs, debugging code snippets.

Job Requirements :

- 6.5-10 years of experience as a Data Engineer with expertise in Microsoft Azure technologies such as ADF, ADLs Gen2, Azure Databricks, Azure Blob Storage.

- Robust proficiency in Python programming language along with PySpark for big-data processing tasks.

- Experience working with SQL databases including designing schema's creating views/stored procedures/functions etc.

📌 Azure Data Engineer (Pune)
🏢 Summit Consulting Services
📍 Pune