01 Sep
|
Questhiring
|
Gurugram
01 Sep
Questhiring
Gurugram
Data Engineer II – GCP Data Platform
Location: Gurgaon
Work Mode: Hybrid
Experience: 4+ Years
About the Role
We are looking for a hands-on Data Engineer II with strong GCP experience to build scalable data pipelines, transformations, and reusable data-platform capabilities.
The role involves taking solutions end-to-end—from design and development to testing, deployment, and production support—while building reliable and reusable data engineering solutions.
Key Responsibilities
- Design, develop, and maintain production-grade data pipelines on GCP.
- Build scalable batch and incremental processing solutions.
- Develop complex transformations using BigQuery, SQL, and Dataform/dbt.
- Build and maintain workflows using Cloud Composer / Apache Airflow.
- Develop reusable transformation components, frameworks, and orchestration patterns.
- Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark.
- Design data models for analytical and downstream data products.
- Implement data-quality checks, validation, reconciliation, and data lineage.
- Optimize pipelines and BigQuery workloads for performance and cloud cost.
- Implement automated testing and integrate data workloads with CI/CD.
- Monitor production pipelines and troubleshoot issues through root-cause analysis.
- Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, and business teams.
Must-Have Skills
- 4+ years of hands-on Data Engineering experience.
- Solid hands-on experience with GCP and BigQuery.
- Advanced SQL – complex joins, CTEs, window functions, and query optimization.
- Strong Python development skills.
- Experience with production ETL/ELT pipelines.
- Hands-on experience with Cloud Composer / Apache Airflow.
- Experience with Dataform and/or dbt.
- Experience with Dataflow / Apache Beam or Dataproc / Spark / PySpark.
- Strong understanding of data modelling and large-scale datasets.
- Experience with incremental and idempotent processi
📌 Data Engineer-II (Gurugram)
🏢 Questhiring
📍 Gurugram