- Design, develop, test, deploy and maintain large-scale data pipelines using Snowflake as the primary database engine.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
- Develop high-quality code in Python using PySpark to process large datasets efficiently.
- Troubleshoot issues related to data quality, performance, and security in Snowflake databases.
Job Requirements :
- 8-12 years of experience in Data Engineering with expertise in Snowflake technology stack (SnowSQL).
- Solid proficiency in Python programming language with experience working with PySpark for big data processing.
- Experience designing scalable architectures for handling massive volumes of structured/unstructured data using Snowflake's features like tables, views, stages etc.