We are looking for a Senior Data Engineer with strong expertise in PySpark, Scala, and Apache Spark. Responsible for designing, building, and optimizing scalable ETL/ELT pipelines and ensuring performance, reliability, and data quality in production systems.
Responsibilities
- Design and build scalable data pipelines using PySpark and Scala
- Optimize Spark jobs for performance and cost efficiency
- Handle batch and streaming data processing
- Ensure data quality and production stability
- Lead troubleshooting and performance tuning efforts