Design, develop, and maintain scalable data pipelines for extracting, transforming, and loading data from various sources to ensure seamless data flow and accessibility.
Collaborate with cross-functional teams to integrate data from multiple disparate sources, ensuring consistency, accuracy, and reliability of data.
Optimize data processing workflows and storage solutions for performance, scalability, and cost-efficiency
Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data throughout the data lifecycle.
Monitor the performance of data pipelines and infrastructure, identifying and resolving issues to maintain system stability and reliability.
Preferred candidate profile
- Strong experience in Snowflake, SQL for data manipulation and engineering tasks.
- Robust Expertise in SQL and Snowflake architecture
- Experience in ETL tools Informatica / DBT
- Experience in one or more cloud platforms Preferably Azure /AWS/GCP
- In-depth knowledge of data warehousing concepts and experience in building and managing data warehouses.
- Knowledge in ETL concepts - needs to manage data migration into Snowflake. This includes extracting data from various sources, transforming it into a usable form, and loading it into the Snowflake platform.