05 Sep
|
Questhiring
|
Gurugram
05 Sep
Questhiring
Gurugram
Job Description
About the job
n
n
Senior Data Engineer - GCP Data Platform
n
Location: Gurgaon
n
Work Mode: Hybrid
n
Experience: 6+ Years
n
n
About the Role
n
We are looking for a hands-on Data Engineer II with strong GCP experience to build scalable data pipelines, transformations, and reusable data-platform capabilities.
n
The role involves taking solutions end-to-end—from design and development to testing, deployment, and production support —while building reliable and reusable data engineering solutions.
n
n
Key Responsibilities
n
n
- Design, develop, and maintain production-grade data pipelines on GCP .
n
- Build scalable batch and incremental processing solutions.
n
- Develop complex transformations using BigQuery, SQL, and Dataform/dbt .
n
- Build and maintain workflows using Cloud Composer / Apache Airflow .
n
- Develop reusable transformation components, frameworks, and orchestration patterns.
n
- Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark .
n
- Design data models for analytical and downstream data products.
n
- Implement data-quality checks, validation, reconciliation, and data lineage.
n
- Optimize pipelines and BigQuery workloads for performance and cloud cost .
n
- Implement automated testing and integrate data workloads with CI/CD .
n
- Monitor production pipelines and troubleshoot issues through root-cause analysis.
n
- Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, and business teams.
n
n
n
Must-Have Skills
n
n
- 6+ years of hands-on Data Engineering experience.
n
- Strong hands-on experience with GCP and BigQuery .
n
- Advanced SQL – complex joins,
CTEs, window functions, and query optimization.
n
- Strong Python development skills.
n
- Experience with production ETL/ELT pipelines.
n
- Hands-on experience with Cloud Composer / Apache Airflow .
n
- Experience with Dataform and/or dbt .
n
- Experience with Dataflow / Apache Beam or Dataproc / Spark / PySpark .
n
- Strong understanding of data modelling and large-scale datasets.
n
- Experience with incremental and idempotent processing.
n
- Understanding of data contracts, schema evolution, data quality, and reconciliation.
n
- Experience with Git, automated testing, and CI/CD .
n
- Strong production troubleshooting and problem-solving skills.
n
n
n
Technical Skills
n
Cloud: GCP, BigQuery, Google Cloud Storage
n
Programming: Python, SQL
n
Data Processing: Dataflow, Apache Beam, Dataproc, Spark/PySpark
n
Orchestration: Cloud Composer, Apache Airflow
n
Transformation: Dataform, dbt
n
Engineering: Git, CI/CD, Automated Testing, Monitoring
n
Data Engineering: ETL/ELT, Batch Processing, Data Modelling, Data Quality, Data Contracts, Metadata & Lineage
n
n
Good to Have
n
n
- Apache Iceberg or up-to-date lakehouse technologies.
n
- Streaming or event-driven processing.
n
- Data Product / Data Mesh concepts.
n
- Metadata-driven or configuration-driven processing.
n
- Change Data Capture (CDC).
n
- Terraform / Infrastructure as Code.
n
- Experience building reusable components for multiple engineering teams.
n
n
n
What We’re Looking For
n
A strong ownership mindset, good analytical and debugging skills, ability to independently design solutions, and the confidence to take data engineering solutions through production.
n
📌 Senior Data Engineer (Gurugram)
🏢 Questhiring
📍 Gurugram