Description :

Overview :

We are seeking a highly skilled and experienced Senior Data Engineer (L4) to join the program in supporting critical customer engagement.

We are looking for a candidate to design and build scalable data pipelines on GCP, responsible for replacing end-of-life legacy ETL tools with contemporary cloud frameworks and building core data models.

This role is ideal for a self-starter who possesses solid analytical problem-solving skills, specifically the ability to reverse-engineer undocumented legacy code and map it to up-to-date logic without losing business context.

The ideal candidate adapts quickly between different technologies (Java, SQL, Python) and maintains rigorous attention to detail to ensure zero-discrepancy migrations.

The successful candidate will work closely with the Program Manager and customer stakeholders to ensure project success from initial definition through final delivery.

Required Credentials :

5 - 7 Years of Experience.

Required Qualifications :
GCP Data Stack : Expertise in BigQuery, Cloud Composer, Cloud SQL, and Dataplex.
Transformation : Proficiency in Dataform, Advanced SQL, and Python.
Legacy Migration : Ability to read and interpret Oozie, Pig, Hive,



and proprietary ETL configurations.
DevOps : Experience with GitHub Actions, Docker, and basic Terraform knowledge.

Useful Qualifications :
Experience with large-scale historical data migrations from on-prem Oracle/MySQL sources.
Familiarity with "Silver and Gold" data modeling layers.

Contractor Scope of Work Delivery Expectations : Below covers the scope of work we anticipate the contractor supporting throughout the project timeline.

Scope And Solution Expectations :
Pipeline Development : Design and implement GCP-based ETL/ELT pipelines using Cloud Composer, BigQuery, and Dataform to replace legacy Hadoop-stack jobs.
Data Modeling : Build core data models (Silver and Gold Layers) in BigQuery for downstream analytics and reporting.
Governance Implementation : Ensure data quality and governance by implementing Dataplex, Data Validation Tools (DVT), and automated quality checks.
Migration Execution : Perform large-scale historical data migrations from on-prem Oracle/MySQL to BigQuery and Cloud SQL.
CI/CD : Develop and implement CI/CD pipelines for all data transformation jobs using GitHub Actions.

📌 Senior Data Engineer Pune
🏢 SteerLean
📍 Pune