Role & responsibilities
We are seeking an experienced Senior Data Engineer to support a strategic SAP HANA to Snowflake Data Platform Modernization initiative. The ideal candidate should possess robust expertise in cloud data engineering, ELT/ETL pipeline development, data modeling, and Snowflake architecture.
The Senior Data
Engineer will be responsible for designing and validating scalable data ingestion and transformation frameworks, building proof-of-concept pipelines, establishing cloud-native engineering patterns, and collaborating with Data Architects, SAP HANA SMEs, BI teams, and business stakeholders to deliver a robust migration strategy. The role requires hands-on experience in designing enterprise data platforms using modern cloud technologies and Medallion Architecture.
Key Responsibilities
- Design and develop scalable ELT/ETL pipelines to migrate data from SAP HANA to Snowflake.
- Build Proof of Concepts (PoCs) to validate migration approaches, performance, and scalability.
- Design and implement Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms.
- Develop historical and incremental data loading frameworks using Change Data Capture (CDC) strategies.
- Create reusable transformation logic using SQL, Python, PySpark, and dbt.
- Design and optimize Snowflake objects including databases, schemas, virtual warehouses, stages, streams, tasks, and Snowpipe.
- Implement Slowly Changing Dimensions (SCD Type 1 & Type 2) and dimensional modeling techniques.
- Perform data profiling, data validation, reconciliation, and quality assessments.
- Optimize SQL queries, ELT processes, and Snowflake compute/storage usage for performance and cost efficiency.
- Evaluate and recommend data ingestion and orchestration tools such as dbt, Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.
- Collaborate with Data Architects and SAP HANA SMEs to define source-to-target mappings and transformation strategies..
- Produce technical design documents, engineering standards, and implementation guidelines.
- Mentor Data Engineers and participate in architecture reviews, code reviews, and Agile ceremonies.
Required Skills
- Strong experience in Snowflake architecture, SQL, Snowpipe, Streams & Tasks, Virtual Warehouses, and performance optimization.
- Hands-on expertise in SQL, Python, and PySpark for building scalable data pipelines.
- Experience in ETL/ELT development, data transformation, and Change Data Capture (CDC).
- Proficiency with dbt and exposure to tools such as Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.
- Strong understanding of Medallion Architecture, dimensional data modeling, and SCD Type 1 & Type 2.
- Experience working with SAP HANA and migrating data to cloud data platforms such as Snowflake.
- Knowledge of cloud platforms (AWS, Azure, or GCP) and cloud storage services.
• Familiarity with Git, Azure DevOps, Jira, and Confluence.
- Excellent analytical, problem-solving, communication, and stakeholder collaboration skills.
Preferred Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
- Experience implementing enterprise-scale Snowflake solutions.
- SnowPro Core Certification or equivalent is preferred.
- Cloud certification (AWS, Azure, or GCP) is an added advantage.
- Experience working in Agile/Scrum environments.
Nice to Have
- Experience with Snowpark.
- Knowledge of AI/ML data engineering concepts.
- Exposure to Large Language Models (LLMs), Prompt Engineering, or Retrieval Augmented Generation (RAG).
- Experience implementing DataOps or CI/CD pipelines for data platforms.
- Experience working with globally distributed teams.
📌 Senior Data Engineer (Pune)
🏢 Movate
📍 Pune