12 Sep
|
Impetus
|
Bengaluru
We are seeking a Senior GCP Data Engineer with 4-8 Years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).
The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.
Key Responsibilities
Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP Build and optimize data pipelines using Python Implement streaming solutions using Pub/Sub and Dataflow Develop and manage batch workflows using Cloud Composer Design and optimize data models and queries in Big Query Work with large-scale, low-latency data stores such as Bigtable Ensure data quality, reliability, performance, and scalability Manage source code, reviews, and collaboration using Git Hub Build and maintain CI/CD pipelines using Git Hub Actions Collaborate with product, platform,
and analytics teams in an Agile setup Required Skills & Qualifications
Robust hands-on experience with Google Cloud Platform (GCP) Proven expertise in batch and real-time data pipelines Strong programming experience in Python Hands-on experience with Big Query, Bigtable, Pub/Sub, Dataflow, and Cloud Composer Solid understanding of data modeling, ETL/ELT, and distributed data systems Proficiency with Git Hub and Git Hub Actions–based CI/CD Experience working in Agile environments Strong knowledge of data security and access management Nice to Have
Experience with data governance, lineage, and observability tools Exposure to large-scale analytics or enterprise data platforms Primary Skills : GCP. Bigdata, Py Spark, GCP, Bigquery, Composer, Python
Seondary Skills : SQL, Spark/Python,
Good to Have : Gen AI
📌 Gcp data engineer (Bengaluru)
🏢 Impetus
📍 Bengaluru