We are looking for an experienced Java and Spark Developer with strong expertise in big data processing, SparkSQL, and the Databricks platform to develop and optimize scalable data solutions.
Key Responsibilities
- Develop and maintain Java applications using Apache Spark and SparkSQL.
- Design scalable data pipelines and workflows using Databricks.
- Optimize Spark jobs for performance and resource efficiency.
- Collaborate with data scientists and engineers to integrate PySpark-based data science models.
- Manage Databricks clusters and Spark job deployments.
- Perform code reviews, testing, debugging, and production issue resolution.
- Mentor junior developers and participate in Agile activities.