02 Sep
|
Questhiring
|
Gurugram
02 Sep
Questhiring
Gurugram
Role: Data Engineer II – GCP Data Platform
Objective of the Role
We are looking for a hands-on Data Engineer II with solid Google Cloud Platform experience to build scalable data pipelines, transformations and reusable data-platform capabilities.
You will work across Data Engineering and Data Platform Engineering , independently delivering production-grade data products while contributing reusable components and engineering patterns that can be adopted across multiple teams and use cases.
The role requires strong hands-on development skills and the ability to take a solution from design through implementation, testing, deployment and production support.
You Will
Design, develop and maintain production-grade data pipelines on Google Cloud Platform .
Build scalable batch and incremental data-processing solutions .
Develop complex transformations using BigQuery, SQL and Dataform / dbt .
Build and maintain data-processing workflows using Cloud Composer / Apache Airflow .
Develop reusable transformation components, orchestration patterns, libraries and templates.
Implement metadata-driven and configuration-driven processing where appropriate.
Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark .
Design data models for analytical and downstream data-product requirements.
Implement incremental and idempotent processing patterns.
Define and maintain schemas and data contracts.
Implement automated data-quality checks, validation and reconciliation.
Capture and integrate metadata and lineage into data-processing workflows.
Optimise BigQuery queries and pipelines for performance and cloud cost.
Implement automated testing and integrate data workloads with CI/CD pipelines.
Build monitoring and operational controls for production pipelines.
Troubleshoot production issues and perform root-cause analysis.
Contribute to reusable data-platform capabilities and engineering standards.
Collaborate with Data Engineers,
📌 IT Data Architect (Gurugram)
🏢 Questhiring
📍 Gurugram