We are looking for a hands-on Data Engineer II with solid Google Cloud Platform experience to build scalable data pipelines, transformations and reusable data-platform capabilities.
You will work across Data Engineering and Data Platform Engineering , independently delivering production-grade data products while contributing reusable components and engineering patterns that can be adopted across multiple teams and use cases.
The role requires solid hands-on development skills and the ability to take a solution from design through implementation, testing, deployment and production support.
You Will
Design, develop and maintain production-grade data pipelines on Google Cloud Platform . Build scalable batch and incremental data-processing solutions . Develop complex transformations using Big Query, SQL and Dataform / dbt . Build and maintain data-processing workflows using Cloud Composer / Apache Airflow . Develop reusable transformation components, orchestration patterns, libraries and templates.
Implement metadata-driven and configuration-driven processing where appropriate. Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark . Design data models for analytical and downstream data-product requirements. Implement incremental and idempotent processing patterns. Define and maintain schemas and data contracts. Implement automated data-quality checks, validation and reconciliation. Capture and integrate metadata and lineage into data-processing workflows. Optimise Big Query queries and pipelines for performance and cloud cost. Implement automated testing and integrate data workloads with CI/CD pipelines. Build monitoring and operational controls for production pipelines. Troubleshoot production issues and perform root-cause analysis. Contribute to reusable data-platform capabilities and engineering standards. Collaborate with Data Engineers, Platform Engine
📌 Data Engineer Gurugram (India)
🏢 Questhiring
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.