- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Warehouses.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex business problems.
- Develop scalable and efficient ETL processes using Azure Databricks to process massive datasets.
- Ensure high availability of data services by implementing monitoring tools such as Azure Monitoring Logs Analytics.
Desired Candidate Profile
- 5-10 years of experience in Data Engineering with expertise in Azure Data Engineering.
- Solid understanding of Azure Databricks, ADF, Azure Data Warehouse, Azure Data Lake Storage (ADLS), and Azure Blob Storage.
- Experience working on big data processing technologies like Spark or Hadoop is an added advantage.