We are looking for an experienced Java + Spark Developer with expertise in Core Java, Apache Spark, and Spark Structured Streaming to build scalable, real-time data processing applications. The ideal candidate should have experience with distributed data systems, lakehouse technologies, and cloud-based analytics platforms.
Key Responsibilities
Develop scalable applications using Core Java and Apache Spark.
Build real-time data pipelines using Spark Structured Streaming.
Design and optimize ETL pipelines and analytical data models.
Work with Delta Lake, Apache Iceberg, or similar lakehouse technologies.
Optimize SQL queries and Spark jobs for performance.
Support ML pipelines using Spark MLlib or similar frameworks.
Implement data governance using Apache Atlas or AWS Lake Formation.
Collaborate with cross-functional teams and participate in code reviews and technical design discussions.
Required Skills
6–11 years of software development experience.
Solid experience in Core Java and Apache Spark.
Hands-on experience with Spark Structured Streaming and real-time analytics.
Strong SQL and data modeling skills.
Experience with distributed systems and ETL development.
Knowledge of Spring Boot and Microservices.
Strong analytical and problem-solving skills.
Preferred Skills
Experience with Delta Lake, Apache Iceberg, or other lakehouse formats.
Exposure to Spark MLlib, MLeap, or machine learning pipelines.
Experience with Apache Atlas or AWS Lake Formation.
Familiarity with Kafka, Docker, Kubernetes, and cloud platforms (AWS/Azure/GCP).
Preferred Certifications
AWS Certified Data Analytics – Specialty
Google Professional Data Engineer
Databricks Certified Associate Developer for Apache Spark
Preferred Candidate Profile
Strong probl
📌 Software Engineer (Pune)
🏢 Sourcingxpress
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.