We are seeking a skilled GCP Data Engineer with robust experience in Google Cloud Platform (GCP) and hands-on expertise in BigQuery, Dataflow, and Dataproc. The ideal candidate will design, develop, optimize, and maintain scalable data pipelines and data platforms to support analytics, reporting, and business intelligence requirements.
Key Responsibilities:
Design, develop, and maintain data ingestion and transformation pipelines on GCP.
Build batch and real-time data processing solutions using Dataflow.
Develop and optimize data warehouse solutions using BigQuery.
Implement large-scale data processing using Dataproc (Spark/Hadoop).
Design ETL/ELT workflows for structured and unstructured data.
Optimize query performance, partitioning, clustering, and cost management in BigQuery.
Collaborate with Data Architects, Business Analysts, and Data Scientists to deliver data solutions.
Troubleshoot data pipeline failures and ensure high availability of data services.
Implement CI/CD processes and automate deployment of data pipelines.