Job Overview:
We are looking for a Tech Lead with robust expertise in PySpark, Apache Spark, and Google Cloud Dataproc to lead the development of scalable data processing solutions.
Key Responsibilities:
Lead and develop scalable data pipelines using PySpark and Apache Spark.
Design, optimize, and manage ETL/ELT pipelines on GCP Dataproc.
Guide the team on Spark development, optimization, and best practices.
Work with BigQuery, GCS, and Cloud Composer/Airflow.
Troubleshoot technical and production issues and ensure reliable data solutions.
Collaborate with stakeholders to understand requirements and deliver solutions.
Required Skills:
5–7 years of experience in Data Engineering/Big Data.
Robust hands-on experience with PySpark, Spark, Python, and SQL.
Robust experience with Google Cloud Dataproc/GCP.
Good knowledge of Spark optimization and performance tuning.
Experience in leading or mentoring technical teams.
Pay: ₹50,000.00 - ₹90,000.00 per month
Benefits:
Provident Fund
Work Location: In person
📌 Pyspark & Dataproc Tech Lead Pune
🏢 ZecData Technology
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.