Location: Hyderabad / Chennai / Bangalore/Pune/Gurgaon ( Onsite )
n
Experience: 5–12 years
n
Role Overview
n
We are looking for a skilled GCP Data Engineer with expertise in Big Query and related Google Cloud Platform services. The candidate will be responsible for designing, building, and optimizing data pipelines and solutions for large-scale data processing and analytics.
n
Key Responsibilities
n
Design and develop data pipelines using GCP services such as Dataflow, Dataproc, Pub/Sub, and Cloud SQL.
Implement and optimize BigQuery for large-scale data analytics.
Build and maintain ETL workflows using Apache Airflow.
Develop scripts and automation using Python, Pandas, and NumPy.
Ensure data quality, security, and compliance across all processes.
Collaborate with data scientists,
analysts, and business stakeholders to deliver robust data solutions.
n
Required Skills
n
Robust experience in Google Cloud Platform (GCP).
Expertise in BigQuery, Dataflow, Dataproc, Cloud SQL, Cloud Spanner, and Pub/Sub.
Proficiency in ETL development and workflow orchestration using Apache Airflow.
Advanced programming skills in Python, with experience in Pandas and NumPy.
Solid understanding of data modeling, data warehousing, and distributed systems.
n
Valuable to Have
n
Experience with streaming data pipelines.
Knowledge of machine learning workflows on GCP.
Familiarity with CI/CD for data engineering.