01 Sep
|
Questhiring
|
Gurugram
01 Sep
Questhiring
Gurugram
Job Description
About the job Senior Data Engineer - GCP Data Platform Location: Gurgaon Work Mode: Hybrid Experience: 6+ Years About the Role We are looking for a hands-on Data Engineer II with solid GCP experience to build scalable data pipelines, transformations, and reusable data-platform capabilities. The role involves taking solutions end-to-end—from design and development to testing, deployment, and production support —while building reliable and reusable data engineering solutions. Key Responsibilities Design, develop, and maintain production-grade data pipelines on GCP . Build scalable batch and incremental processing solutions. Develop complex transformations using BigQuery, SQL, and Dataform/dbt . Build and maintain workflows using Cloud Composer / Apache Airflow . Develop reusable transformation components, frameworks, and orchestration patterns. Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark . Design data models for analytical and downstream data products. Implement data-quality checks, validation, reconciliation,
and data lineage. Optimize pipelines and BigQuery workloads for performance and cloud cost . Implement automated testing and integrate data workloads with CI/CD . Monitor production pipelines and troubleshoot issues through root-cause analysis. Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, and business teams. Must-Have Skills 6+ years of hands-on Data Engineering experience. Strong hands-on experience with GCP and BigQuery . Advanced SQL – complex joins, CTEs, window functions, and query optimization. Strong Python development skills. Experience with production ETL/ELT pipelines. Hands-on experience with Cloud Composer / Apache Airflow . Experience with Dataform and/or dbt . Experience with Dataflow / Apache Beam or Dataproc / Spark / PySpark . Strong understanding of data modelling and large-scale datasets. Experience with incremental and idempotent processing
📌 Senior Data Engineer (Gurugram)
🏢 Questhiring
📍 Gurugram