- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions etc.
- Collaborate with cross-functional teams to gather requirements and design ETL processes for data warehousing solutions on Snowflake.
- Develop complex SQL queries to extract insights from large datasets stored in Snowflake tables.
- Troubleshoot issues related to pipeline failures or performance bottlenecks.
Job Requirements :
- 7-9 years of experience in building scalable data pipelines on AWS platform.
- Robust expertise in developing ETL processes using various tools like Redshift, Glue, Lambda etc. .
- Proficiency in writing complex SQL queries for querying large datasets stored in Snowflake tables.