Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Airflow on Google Cloud Platform (GCP).
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
- Develop scalable and efficient ETL processes using PySpark, BigQuery, PubSub, SQL to extract insights from structured and unstructured data sources.
- Troubleshoot issues related to pipeline failures or performance bottlenecks in real-time.
Job Requirements :
- 5-10 years of experience in Data Engineering with expertise in GCP technologies such as Airflow, BigQuery, PubSub etc. .
- Solid proficiency in Python programming language along with experience working with PySpark framework.
- Experience with SQL querying languages like SQL is required.
📌 GCP Data Engineer (Hyderabad)
🏢 EY
📍 Hyderabad