Job Description ? Snowflake Data Engineer (Retail Domain)
Experience: 4?8 Years
Domain: Retail
Job Summary
We are seeking an experienced Snowflake Data Engineer to design, develop, and support enterprise data warehouse solutions. The ideal candidate should have solid expertise in Snowflake, AWS, Apache Airflow, and data warehousing concepts, along with exposure to Python-based ETL development and modern data platform technologies.
Primary Skills
- Snowflake
- SQL
- Stored Procedures
- Data Transformations
- Role-Based Access Control (RBAC)
- Dynamic Data Masking
- Data Governance
- Performance Optimization
- AWS
- Amazon S3
- Amazon EMR (Elastic MapReduce)
- Apache Airflow
- Workflow Orchestration
- DAG Development and Scheduling
- Monitoring and Troubleshooting
- GitHub
- Source Code Management
- Branching and Version Control
- Data Warehousing
- Dimensional Modeling
- Star and Snowflake Schemas
- Fact and Dimension Tables
- Types of Facts (Transactional, Snapshot, Accumulating Snapshot)
Secondary Skills / Knowledge
- GitHub Actions for CI/CD
- Python for ETL Development
- Data Extraction from MySQL and other source systems
- Understanding of Open Table Formats (Apache Iceberg, Delta Lake, Apache Hudi)
- Snowpark
- Data Pipeline Automation
- Query Performance Tuning
Key Responsibilities
- Develop and maintain scalable data solutions using Snowflake.
- Design and implement data warehouse models and transformation pipelines.
- Build and manage workflow orchestration using Apache Airflow.
- Implement security and governance controls, including RBAC and Dynamic Data Masking.
- Work with AWS S3 and EMR for data ingestion and processing.
- Develop and optimize SQL queries, stored procedures, and data transformations.
- Collaborate with business and technical teams to deliver reporting and analytics solutions.
- Manage source code through GitHub and support CI/CD processes.
- Ensure data quality, performance, scalability, and reliability of the data platform.