- Design and implement data pipelines using Airflow to extract, transform, and load data from various sources into Snowflake.
- Collaborate with cross-functional teams to identify business requirements and develop solutions that meet those needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Snowflake.
- Ensure high availability of the data pipeline by monitoring its performance, identifying bottlenecks, and implementing improvements.
Job Requirements :
- 12-18 years of experience in designing and building large-scale data pipelines using Airflow.
- Robust understanding of Snowflake's architecture, features, and best practices for optimizing query performance.
- Proficiency in developing complex SQL queries for extracting, transforming, and loading (ETL) processes.
- Experience working on big data projects involving multiple stakeholders across different time zones.