07 Sep
|
Berribot
|
Bengaluru
07 Sep
Berribot
Bengaluru
We're Hiring | GCP Data Engineer | Pan India | TS We are looking for experienced GCP Data Engineers to join our growing team. The ideal candidate should have strong hands-on experience in BigQuery-based data warehousing, Dataproc/Spark processing, and orchestrated, cost-effective pipelines to deliver scalable analytics and AI-ready data products for BFSI clients.
Experience
Full-time
Strong experience and understanding of Data Warehouse and Data Lake platform architecture and design.
Design and develop scalable batch and streaming pipelines on GCP using Dataflow, Dataproc (Spark), Pub/Sub, and Cloud Functions.
Build and optimise cloud data warehouse solutions on BigQuery, including partitioning, clustering, and query cost optimisation.
Migrate and modernise legacy workloads (Hadoop, Teradata, on-prem ETL)
to GCP using Dataproc, BigQuery, and Data Fusion.
Develop ELT/ETL workflows with Python, Java, Scala, and PySpark; orchestrate pipelines using Cloud Composer (Airflow).
Implement data security and governance via Cloud IAM, and build reusable data validation and reconciliation frameworks.
Tune Spark and BigQuery workloads for performance and cost, achieving measurable runtime and storage improvements.
Set up CI/CD and automation for GCP data assets using Git-based pipelines and infrastructure-as-code.
Google Cloud Platform (BigQuery, Dataproc, Dataflow)
Pub/Sub, Cloud Functions, Data Fusion, Data
📌 Gcp Data Engineer (Bengaluru)
🏢 Berribot
📍 Bengaluru