Role: Data Engineer II – GCP Data Platform Objective of the Role We are looking for a hands-on Data Engineer II with strong Google Cloud Platform experience to build scalable data pipelines, transformations and reusable data-platform capabilities. You will work across Data Engineering and Data Platform Engineering, independently delivering production-grade data products while contributing reusable components and engineering patterns that can be adopted across multiple teams and use cases. The role requires solid hands-on development skills and the ability to take a solution from design through implementation, testing, deployment and production support. You Will Design, develop and maintain production-grade data pipelines on Google Cloud Platform. Build scalable batch and incremental data-processing solutions. Develop complex transformations using Big Query, SQL and Dataform / dbt. Build and maintain data-processing workflows using Cloud Composer / Apache Airflow. Develop reusable transformation components, orchestration patterns, libraries and templates.
Implement metadata-driven and configuration-driven processing where appropriate. Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark. Design data models for analytical and downstream data-product requirements. Implement incremental and idempotent processing patterns. Define and maintain schemas and data contracts. Implement automated data-quality checks, validation and reconciliation. Capture and integrate metadata and lineage into data-processing workflows. Optimise Big Query queries and pipelines for performance and cloud cost. Implement automated testing and integrate data workloads with CI/CD pipelines. Build monitoring and operational controls for production pipelines. Troubleshoot production issues and perform root-cause analysis. Contribute to reusable data-platform capabilities and engineering standards. Collaborate with Data Engineers, Platform Engineers, Dev Op
📌 Data Engineer (Gurugram)
🏢 Questhiring
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.