Roles and Responsibilities :

- Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to integrate various data sources into SQL Azure databases.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs.
- Develop machine learning models using PySpark on Azure Databricks to analyze complex datasets and provide insights for business decision making.
- Ensure high availability, scalability, security, and performance of all deployed systems by implementing DevOps practices such as continuous integration/continuous deployment (CI/CD).

Job Requirements :

- 6-10 years of experience in IT Services & Consulting industry with expertise in Microsoft Azure technologies including ADF, SQL Azure, PySpark on Azure Databricks.
- Robust understanding of machine learning concepts and ability to apply them in real-world scenarios.
- Experience with DevOps tools such as CI/CD pipelines for automated testing and deployment of applications.

📌 Azure Data Engineer (Karnataka)
🏢 Sapient (publicissapient)
📍 Karnataka