Roles and Responsibilities

- Design, develop, and maintain large-scale data pipelines using Apache Spark, PySpark, and SQL.

- Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.

- Develop complex data models, perform exploratory data analysis (EDA), query optimization, and database design for effective data processing.

- Ensure timely delivery of projects by managing project timelines, resources, and stakeholders effectively.

- Troubleshoot issues related to big data processing, data quality, and performance tuning.

Desired Candidate Profile

- 4-7 years of experience in Data Engineering with expertise in Apache Spark/PySpark/SQL.

- Bachelor's degree in Computer Science and Engineering (CSE) or equivalent from a reputed institution.

- Strong understanding of Big Data concepts including Hadoop ecosystem components such as HDFS/Hive/Pig etc. .

- Proficiency in developing complex SQL queries with knowledge of user-defined functions (UDFs) and views.

📌 Senior Data Engineer (Mumbai)
🏢 trustklub consulting
📍 Mumbai