06 Sep
|
Berribot
|
Vasanthanagar
06 Sep
Berribot
Vasanthanagar
Job Description
We're Hiring | GCP Data Engineer | Pan India | TS
We are looking for experienced GCP Data Engineers to join our growing team. The ideal candidate should have strong hands-on experience in BigQuery-based data warehousing, Dataproc/Spark processing, and orchestrated, cost-efficient pipelines to deliver scalable analytics and AI-ready data products for BFSI clients.
Location
Pan India
Experience
6–10 Years (role-dependent), including 3+ years hands-on GCP
Employment Type
Full-time
Key Responsibilities
- Robust experience and understanding of Data Warehouse and Data Lake platform architecture and design.
- Design and develop scalable batch and streaming pipelines on GCP using Dataflow, Dataproc (Spark), Pub/Sub, and Cloud Functions.
- Build and optimise cloud data warehouse solutions on BigQuery, including partitioning, clustering, and query cost optimisation.
- Migrate and modernise legacy workloads (Hadoop, Teradata,
on-prem ETL) to GCP using Dataproc, BigQuery, and Data Fusion.
- Develop ELT/ETL workflows with Python, Java, Scala, and PySpark; orchestrate pipelines using Cloud Composer (Airflow).
- Implement data security and governance via Cloud IAM, and build reusable data validation and reconciliation frameworks.
- Tune Spark and BigQuery workloads for performance and cost, achieving measurable runtime and storage improvements.
- Set up CI/CD and automation for GCP data assets using Git-based pipelines and infrastructure-as-code.
- Collaborate with architects and client teams on solutioning, PoCs, demos, and production cutover.
Mandatory Skills
- Google Cloud Platform (BigQuery, Dataproc, Dataflow)
- Pub/Sub, Cloud Functions, Data Fusion, Data
📌 GCP Data Engineer (Vasanthanagar)
🏢 Berribot
📍 Vasanthanagar