13 Sep
|
Questhiring
|
Gurugram
13 Sep
Questhiring
Gurugram
About the job /n /n Senior Data Engineer - GCP Data Platform /n Location: Gurgaon /n Work Mode: Hybrid /n Experience: 6+ Years /n /n About the Role /n We are looking for a hands-on Data Engineer II with strong GCP experience to build scalable data pipelines, transformations, and reusable data-platform capabilities. /n The role involves taking solutions end-to-end—from design and development to testing, deployment, and production support —while building reliable and reusable data engineering solutions. /n /n Key Responsibilities /n /n
- Design, develop, and maintain production-grade data pipelines on GCP .
/n
- Build scalable batch and incremental processing solutions.
/n
- Develop complex transformations using BigQuery, SQL, and Dataform/dbt .
/n
- Build and maintain workflows using Cloud Composer / Apache Airflow .
/n
- Develop reusable transformation components, frameworks, and orchestration patterns.
/n
- Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark .
/n
- Design data models for analytical and downstream data products.
/n
- Implement data-quality checks, validation, reconciliation, and data lineage.
/n
- Optimize pipelines and BigQuery workloads for performance and cloud cost .
/n
- Implement automated testing and integrate data workloads with CI/CD .
/n
- Monitor production pipelines and troubleshoot issues through root-cause analysis.
/n
- Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, and business teams.
/n /n /n Must-Have Skills /n /n
- 6+ years of hands-on Data Engineering experience.
/n
- Solid hands-on experience with GCP and BigQuery .
/n
- Advanced SQL – complex joins, CTEs,
window functions, and query optimization.
/n
- Strong Python development skills.
/n
- Experience with production ETL/ELT pipelines.
/n
- Hands-on experience with Cloud Composer / Apache Airflow .
/n
- Experience with Dataform and/or dbt .
/n
- Experience with Dataflow / Apache Beam or Dataproc / Spark / PySpark .
/n
- Strong understanding of data modelling and large-scale datasets.
/n
- Experience with incremental and idempotent processing.
/n
- Understanding of data contracts, schema evolution, data quality, and reconciliation.
/n
- Experience with Git, automated testing, and CI/CD .
/n
- Strong production troubleshooting and problem-solving skills.
/n /n /n Technical Skills /n Cloud: GCP, BigQuery, Google Cloud Storage /n Programming: Python, SQL /n Data Processing: Dataflow, Apache Beam, Dataproc, Spark/PySpark /n Orchestration: Cloud Composer, Apache Airflow /n Transformation: Dataform, dbt /n Engineering: Git, CI/CD, Automated Testing, Monitoring /n Data Engineering: ETL/ELT, Batch Processing, Data Modelling, Data Quality, Data Contracts, Metadata & Lineage /n /n Good to Have /n /n
- Apache Iceberg or modern lakehouse technologies.
/n
- Streaming or event-driven processing.
/n
- Data Product / Data Mesh concepts.
/n
- Metadata-driven or configuration-driven processing.
/n
- Change Data Capture (CDC).
/n
- Terraform / Infrastructure as Code.
/n
- Experience building reusable components for multiple engineering teams.
/n /n /n What We’re Looking For /n A strong ownership mindset, good analytical and debugging skills, ability to independently design solutions, and the confidence to take data engineering solutions through production. /n
📌 Senior Data Engineer (Gurugram)
🏢 Questhiring
📍 Gurugram