Role & responsibilities
Develop and maintain data processing applications using PySpark and Python.
Work with large datasets and perform data transformations.
Develop and optimize Spark jobs.
Write clean and productive Python code.
Troubleshoot and resolve data processing issues.
Collaborate with the data engineering team to deliver solutions.