13 Sep
|
Berribot
|
Bengaluru
13 Sep
Berribot
Bengaluru
We're Hiring | GCP Data Engineer | Pan India | TS /n We are looking for experienced GCP Data Engineers to join our growing team. The ideal candidate should have solid hands-on experience in BigQuery-based data warehousing, Dataproc/Spark processing, and orchestrated, cost-efficient pipelines to deliver scalable analytics and AI-ready data products for BFSI clients. /n Location /n Pan India /n Experience /n 6–10 Years (role-dependent), including 3+ years hands-on GCP /n Employment Type /n Full time /n Key Responsibilities /n /n
Strong experience and understanding of Data Warehouse and Data Lake platform architecture and design.
/n
Design and develop scalable batch and streaming pipelines on GCP using Dataflow, Dataproc (Spark), Pub/Sub, and Cloud Functions.
/n
Build and optimise cloud data warehouse solutions on BigQuery, including partitioning, clustering, and query cost optimisation.
/n
Migrate and modernise legacy workloads (Hadoop, Teradata, on-prem ETL) to GCP using Dataproc, BigQuery, and Data Fusion.
/n
Develop ELT/ETL workflows with Python, Java, Scala, and PySpark; orchestrate pipelines using Cloud Composer (Airflow).
/n
Implement data security and governance via Cloud IAM, and build reusable data validation and reconciliation frameworks.
/n
Tune Spark and BigQuery workloads for performance and cost, achieving measurable runtime and storage improvements.
/n
Set up CI/CD and automation for GCP data assets using Git-based pipelines and infrastructure-as-code.
/n
Collaborate with architects and client teams on solutioning, PoCs, demos, and production cutover.
/n /n Mandatory Skills /n /n
Google Cloud Platform (BigQuery, Dataproc, Dataflow)
/n
Pub/Sub, Cloud Functions, Data Fusion, Data Transfer
/n
PySpark/Spark, Python, SQL (Java/Scala a plus)
/n
Cloud Composer (Airflow) orchestration
/n
Data warehouse & pipeline design + performance tuning
/n
Cloud IAM — data security & access governance
/n /n Valuable to Have /n /n
Legacy migration (Hadoop/Teradata/on-prem ETL)
/n
GCP Kubernetes Engine (GKE), Cloud Storage
/n
CI/CD, Git, infrastructure-as-code (Terraform)
/n
Data validation/DVT frameworks & automation
/n
BI & analytics — Looker, Power BI, Tableau
/n
Exposure to Vertex AI/GenAI on GCP
/n /n Your Next Career Chance Awaits! /n Apply now and get a faster recruitment process. /n Click here to apply
📌 Gcp Data Engineer Bengaluru
🏢 Berribot
📍 Bengaluru