09 Sep
|
Berribot
|
Vasanthanagar
09 Sep
Berribot
Vasanthanagar
Job DescriptionWe're Hiring | GCP Data Engineer | Pan India | TS NWe are looking for experienced GCP Data Engineers to join our growing team. The ideal candidate should have strong hands-on experience in BigQuery-based data warehousing, Dataproc/Spark processing, and orchestrated, cost-efficient pipelines to deliver scalable analytics and AI-ready data products for BFSI clients. NLocationnPan India NExperiencen6–10 Years (role-dependent), including 3+ years hands-on GCP NEmployment TypenFull-time NKey Responsibilitiesn N Solid experience and understanding of Data Warehouse and Data Lake platform architecture and design. N Design and develop scalable batch and streaming pipelines on GCP using Dataflow, Dataproc (Spark), Pub/Sub, and Cloud Functions. N Build and optimise cloud data warehouse solutions on BigQuery, including partitioning, clustering, and query cost optimisation. N Migrate and modernise legacy workloads (Hadoop, Teradata, on-prem ETL) to GCP using Dataproc, BigQuery, and Data Fusion. N Develop ELT/ETL workflows with Python, Java, Scala, and PySpark; orchestrate pipelines using Cloud Composer (Airflow). N Implement data securityand governance via Cloud IAM,
and build reusable data validation and reconciliation frameworks. N Tune Spark and BigQueryworkloads for performance and cost, achieving measurable runtime and storage improvements. N Set up CI/CD and automation for GCP data assets using Git-based pipelines and infrastructure-as-code. N Collaborate with architects and client teams on solutioning, PoCs, demos, and production cutover. NnMandatory Skills Nn Google Cloud Platform (BigQuery, Dataproc, Dataflow) N Pub/Sub, Cloud Functions, Data Fusion, Data Transfer N PySpark/Spark, Python, SQL (Java/Scala a plus) N Cloud Composer (Airflow) orchestration N Data warehouse & pipeline design + performance tuning N Cloud IAM — data security & access governance NnGood to Haven N Legacy migration (Hadoop/Teradata/on-prem ETL) N GCP Kubernetes Engine (GKE), Cloud Storage N CI/CD, Git, infrastructure-as-code (Terraform) N Data validation/DVT frameworks & automation N BI & analytics — Looker, Power BI, Tableau N Exposure to Vertex AI/GenAI on GCP NnYour Next Career Opportunity Awaits! NApply now and get a faster recruitment process. NClick here to apply
📌 Gcp Data Engineer (Vasanthanagar)
🏢 Berribot
📍 Vasanthanagar