Job Description
Role & responsibilities
We are seeking an experienced Senior Data Engineer to support a strategic SAP HANA to Snowflake Data Platform Modernization initiative. The ideal candidate should possess strong expertise in cloud data engineering, ELT/ETL pipeline development, data modeling, and Snowflake architecture. The Senior Data Engineer will be responsible for designing and validating scalable data ingestion and transformation frameworks, building proof-of-concept pipelines, establishing cloud-native engineering patterns, and collaborating with Data Architects, SAP HANA SMEs, BI teams, and business stakeholders to deliver a robust migration strategy. The role requires hands-on experience in designing enterprise data platforms using up-to-date cloud technologies and Medallion Architecture.
Key Responsibilities
• Design and develop scalable ELT/ETL pipelines to migrate data from SAP HANA to Snowflake.
• Build Proof of Concepts (PoCs) to validate migration approaches, performance, and scalability.
• Design and implement Medallion Architecture (Bronze, Silver, Gold)
for enterprise data platforms.
- Develop historical and incremental data loading frameworks using Change Data Capture (CDC) strategies.
- Create reusable transformation logic using SQL, Python, PySpark, and dbt.
- Design and optimize Snowflake objects including databases, schemas, virtual warehouses, stages, streams, tasks, and Snowpipe.
- Implement Slowly Changing Dimensions (SCD Type 1 & Type 2) and dimensional modeling techniques.
- Perform data profiling, data validation, reconciliation, and quality assessments.
- Optimize SQL queries, ELT processes, and Snowflake compute/storage usage for performance and cost efficiency.
- Evaluate and recommend data ingestion and orchestration tools such as dbt, Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow.
- Collaborate with Data Architects and SAP HANA SMEs to define source-to-target mappings and transformation strategies..
- P
📌 Senior Data Engineer (Pune)
🏢 CSS Corp
📍 Pune