- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into a centralized data warehouse.
- Collaborate with cross-functional teams to gather requirements for reporting needs and design scalable solutions that meet business objectives.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases.
- Ensure high availability of critical systems by implementing monitoring tools, logging mechanisms, and alerting configurations.
Job Requirements :
- 10-15 years of experience in IT Services & Consulting industry as a Senior Data Engineer or similar role.
- Solid expertise in cloud technologies such as AWS or GCP; knowledge of both is an added advantage.
- Proficiency in working with big-data technologies like PySpark on Azure Databricks platform.