experience to build scalable data pipelines, transformations, and reusable data-platform capabilities.
The role involves taking solutions end-to-end—from
design and development to testing, deployment, and production support —while building reliable and reusable data engineering solutions.
Key Responsibilities
Design, develop, and maintain production-grade
data pipelines on GCP .
Build scalable
batch and incremental processing
solutions.
Develop complex transformations using
BigQuery, SQL, and Dataform/dbt .
Build and maintain workflows using
Cloud Composer / Apache Airflow .
Develop reusable transformation components, frameworks, and orchestration patterns.
Build distributed data-processing solutions using
Dataflow / Apache Beam and/or Dataproc / Spark .
Design data models for analytical and downstream data products.
Implement data-quality checks, validation, reconciliation, and data lineage.
Optimize pipelines and BigQuery workloads for
performance and cloud cost .
Implement automated testing and integrate data workloads with
CI/CD .
Monitor production pipelines and troubleshoot issues through root-cause analysis.
Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, and business teams.
Must-Have Skills
4+ years
of hands-on Data Engineering experience.
Strong hands-on experience with
GCP
and
BigQuery .
Advanced
SQL
– complex joins, CTEs, window functions, and query optimization.
Solid
Python
development skills.
Experience with production
ETL/ELT
pipelines.
Hands-on experience with
Cloud Composer / Apache Airflow .
Experience with
Dataform and/or dbt .
Experience with
Dataflow / Apache Beam or Dataproc / Spark / PySpark .
Solid understanding of
data modelling
and large-scale datasets.
Experience with incremental and idempotent processing
📌 Data Engineer Ii Mumbai
🏢 Questhiring
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.