09 Sep
|
Berribot
|
Bengaluru
09 Sep
Berribot
Bengaluru
Job DescriptionWe're Hiring | GCP Data Engineer | Pan India | TS
NWe are looking for experienced GCP Data Engineers to join our growing team. The ideal candidate should have strong hands-on experience in BigQuery-based data warehousing, Dataproc/Spark processing, and orchestrated, cost-productive pipelines to deliver scalable analytics and AI-ready data products for BFSI clients.
NLocation
nPan India
NExperience
n6–10 Years (role-dependent), including 3+ years hands-on GCP
NEmployment Type
nFull-time
NKey Responsibilities
n
- N
- Strong experience and understanding of Data Warehouse and Data Lake platform architecture and design. N
- Design and develop scalable batch and streaming pipelines on GCP using Dataflow, Dataproc (Spark), Pub/Sub, and Cloud Functions. N
- Build and optimise cloud data warehouse solutions on BigQuery, including partitioning, clustering, and query cost optimisation. N
- Migrate and modernise legacy workloads (Hadoop, Teradata, on-prem ETL) to GCP using Dataproc, BigQuery, and Data Fusion. N
- Develop ELT/ETL workflows with Python, Java,
Scala, and PySpark;
orchestrate pipelines using Cloud Composer (Airflow). N
- Implement data securityand governance via Cloud IAM, and build reusable data validation and reconciliation frameworks. N
- Tune Spark and BigQueryworkloads for performance and cost, achieving measurable runtime and storage improvements. N
- Set up CI/CD and automation for GCP data assets using Git-based pipelines and infrastructure-as-code. N
- Collaborate with architects and client teams on solutioning, PoCs, demos, and production cutover. N
nMandatory Skills
N
- n
- Google Cloud Platform (BigQuery, Dataproc, Dataflow) N
- Pub/Sub, Cloud Functions, Data Fusion, Data Transfer N
- PySpark/Spark, Python, SQL (Java/Scala a plus) N
- Cloud Composer (Airflow) orchestration N
- Data warehouse & pipeline design + performance tuning N
- Cloud IAM — data security & access governance N
nGood to Have
n
-
📌 Hiring: Gcp Data Engineer (Bengaluru)
🏢 Berribot
📍 Bengaluru