01 Sep
|
Questhiring
|
Gurugram
01 Sep
Questhiring
Gurugram
Role: Data Engineer II – GCP Data Platform
Objective of the Role
We are looking for a hands-on Data Engineer II with strong Google Cloud Platform experience to build scalable data pipelines, transformations and reusable data-platform capabilities.
You will work across Data Engineering and Data Platform Engineering , independently delivering production-grade data products while contributing reusable components and engineering patterns that can be adopted across multiple teams and use cases.
The role requires solid hands-on development skills and the ability to take a solution from design through implementation, testing, deployment and production support.
You Will
Design, develop and maintain production-grade data pipelines on Google Cloud Platform . Build scalable batch and incremental data-processing solutions . Develop complex transformations using Big Query, SQL and Dataform / dbt . Build and maintain data-processing workflows using Cloud Composer / Apache Airflow . Develop reusable transformation components, orchestration patterns, libraries and templates.
Implement metadata-driven and configuration-driven processing where appropriate. Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark . Design data models for analytical and downstream data-product requirements. Implement incremental and idempotent processing patterns. Define and maintain schemas and data contracts. Implement automated data-quality checks, validation and reconciliation. Capture and integrate metadata and lineage into data-processing workflows. Optimise Big Query queries and pipelines for performance and cloud cost. Implement automated testing and integrate data workloads with CI/CD pipelines. Build monitoring and operational controls for production pipelines. Troubleshoot production issues and perform root-cause analysis. Contribute to reusable data-platform capabilities and engineering standards. Collaborate with Data Engineers, Platform Engine
📌 Data Engineer (Gurugram)
🏢 Questhiring
📍 Gurugram