14 Aug
|
The Whiteboard
|
Bengaluru
14 Aug
The Whiteboard
Bengaluru
Data Engineer – GCP
- Experience: 6 - 8 years
- Primary Skills: GCP, BigQuery, Dataflow, Dataform, Airflow, Datastream, SQL, Python
- Notice Period: Immediate
- Location: Chennai / Bangalore / Coimbatore / Pune (Hybrid)
– Senior Data Engineer (GCP)
Role: Data Engineer
Experience: 6 + Years
Location: Chennai / Bangalore / Pune / Coimbatore
Work Mode: Hybrid
Contract & Extendable
About the Role
We are looking for an experienced Senior Data Engineer with strong expertise in Google Cloud Platform (GCP) and modern data engineering technologies. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data processing solutions using GCP services.
The candidate should have hands-on experience with BigQuery, Dataflow, Dataform, Airflow, and Datastream, along with strong SQL and data engineering fundamentals.
Key Responsibilities
•Design, develop, and maintain scalable data pipelines using GCP services.
•Build and optimize data processing pipelines using Google Cloud Dataflow.
•Develop and manage analytical datasets and data models in BigQuery.
•Use Dataform for data transformation, modeling, testing, and dependency management.
•Develop and manage workflow orchestration using Apache Airflow / Cloud Composer.
•Implement data ingestion and replication pipelines using Google Cloud Datastream.
•Develop robust ETL/ELT pipelines for processing structured and semi-structured data.
•Optimize BigQuery queries, data models, and pipeline performance.
•Implement data quality checks, monitoring, error handling, and troubleshooting.
•Collaborate with Data Scientists, Data Analysts, Architects, and other engineering teams.
•Follow best practices for data security, governance, scalability, and reliability.
•Participate in code reviews, technical discussions, and production support activities.
Required Skills
• 6 – 8 years of experience in Data Engineering.
•Strong hands-on experience with Google Cloud Platform (GCP).
•Strong expertise in BigQuery.
•Hands-on experience with Google Cloud Dataflow.
•Experience with Dataform for data transformation and modeling.
•Strong experience with Apache Airflow / Cloud Composer.
•Hands-on experience with Google Cloud Datastream.
•Robust SQL skills and experience working with large datasets.
•Good understanding of ETL/ELT concepts and data warehousing.
•Experience in designing scalable and reliable data pipelines.
•Strong troubleshooting and problem-solving skills.
📌 Senior Data Engineer – GCP (6-8Yrs) Contract (Bengaluru)
🏢 The Whiteboard
📍 Bengaluru