- Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Snowflake.
- Collaborate with cross-functional teams to gather requirements for ETL processes and ensure seamless integration with existing systems.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Snowflake.
- Implement automated testing frameworks to ensure high-quality delivery of ETL jobs.
Desired Candidate Profile
- 5-8 years of experience in Data Engineering with expertise in ADF, ETL, Snowflake, and Azure Databricks.
- Robust understanding of cloud-based technologies such as AWS or GCP is an added advantage.
- Proficiency in writing efficient SQL queries for querying large datasets.
- Experience working on big-data processing tasks including batch/streaming data ingestion.