03 Aug
|
Zorba AI
|
India
Job Description
We are looking for a highly skilled GCP Data Engineer with 5+ years of experience in designing and building scalable data solutions on Google Cloud Platform. The ideal candidate will have strong expertise in Big Query, Python, and up-to-date data engineering practices, with a focus on performance, reliability, and cost optimization.
Key Responsibilities
Design, develop, and maintain scalable and robust data pipelines on GCP
Build and optimize data warehouses using Big Query (partitioning, clustering, query tuning)
Develop ETL/ELT pipelines using Python and GCP-native tools
Integrate data from multiple sources including APIs, databases, and streaming platforms
Ensure high performance and cost efficiency of data processing systems
Collaborate with data analysts, data scientists, and business stakeholders
Implement data quality checks, governance, and security standards
Monitor, debug, and optimize data workflows and pipelines
Support batch and real-time data processing requirements
Required Skills
5+ years of hands-on experience in Data Engineering
Strong experience with Google Cloud Platform (GCP)
Expertise in Big Query (data modeling, performance tuning)
Strong programming skills in Python (Pandas; PySpark is a plus)
Experience with Cloud Composer / Apache Airflow
Knowledge of Cloud Storage, Pub/Sub, Dataflow
Advanced SQL and robust data warehousing concepts
Experience building scalable ETL/ELT pipelines
Preferred Skills
Experience with Apache Spark / Databricks
Familiarity with CI/CD pipelines and Dev Ops practices
Knowledge of data visualization tools like Tableau / Looker
Experience with streaming data processing
Exposure to data lake / lakehouse architectures
Educational Qualification
Bachelors or Master's degree in Computer Science, IT, or related field
Positive to Have
GCP Certification (e.g., Skilled Data Engineer)
Experience working in Agile/Scrum environments
Skills: scala,python,gcp,spark
📌 Gcp De 6+ Years Pune (India)
🏢 Zorba AI
📍 India