We are looking for a skilled Data Engineer with hands-on experience in GCP, Python, and PySpark to build and optimize scalable data pipelines and ETL workflows.
Key Skills:
-
Strong experience in Python, PySpark, GCP, BigQuery, Dataproc, and Apache Airflow
-
Hands-on experience in developing, deploying, monitoring, and optimizing batch ETL workflows
-
Good understanding of Medallion Architecture, data quality checks, and data summarization
-
Experience in performance optimization, observability, and runbook creation
-
Robust knowledge of Airflow orchestration, dependency handling, scheduling, and idempotent execution
-
Exposure to Data Governance is an added advantage
Roles & Responsibilities:
-
Develop and maintain scalable ETL pipelines using Python and PySpark on GCP.
-
Design and optimize batch data processing workflows using BigQuery, Dataproc, and Airflow.
-
Implement data quality checks and performance optimization techniques.
-
Monitor production pipelines, troubleshoot issues, and create operational runbooks.
-
Collaborate with cross-functional teams to deliver reliable and scalable data solutions.
📌 Data Engineer (Chennai)
🏢 Zorba Consulting India
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.