22 Sep
|
wissen technology
|
Mumbai
22 Sep
wissen technology
Mumbai
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Airflow on GCP.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
- Develop high-quality code in Python using Spark and SQL to process large datasets.
- Troubleshoot issues related to pipeline failures and optimize performance for improved efficiency.
Job Requirements :
- 8-15 years of experience in Data Engineering with expertise in Airflow, GCP, Python (including Spark), SQL.
- Solid understanding of cloud-based technologies such as Google Cloud Platform (GCP).
- Experience working with big data tools like BigQuery, Pub/Sub etc.
📌 Data Engineer (Mumbai)
🏢 wissen technology
📍 Mumbai