We are looking for an experienced Java + Spark Developer with expertise in Core Java, Apache Spark, and Spark Structured Streaming to build scalable, real-time data processing applications. The ideal candidate should have experience with distributed data systems, lakehouse technologies, and cloud-based analytics platforms.
Key Responsibilities
- Develop scalable applications using Core Java and Apache Spark.
- Build real-time data pipelines using Spark Structured Streaming.
- Design and optimize ETL pipelines and analytical data models.
- Work with Delta Lake, Apache Iceberg, or similar lakehouse technologies.
- Optimize SQL queries and Spark jobs for performance.
- Support ML pipelines using Spark MLlib or similar frameworks.
- Implement data governance using Apache Atlas or AWS Lake Formation.
- Collaborate with cross-functional teams and participate in code reviews and technical design discussions.
Required Skills
- 6–11 years of software development experience.
- Strong experience in Core Java and Apache Spark.
- Hands-on experience with Spark Structured Streaming and real-time analytics.
- Strong SQL and data modeling skills.
- Experience with distributed systems and ETL development.
- Knowledge of Spring Boot and Microservices.
- Solid analytical and problem-solving skills.
Preferred Skills
- Experience with Delta Lake, Apache Iceberg, or other lakehouse formats.
- Exposure to Spark MLlib, MLeap, or machine learning pipelines.
- Experience with Apache Atlas or AWS Lake Formation.
- Familiarity with Kafka, Docker, Kubernetes, and cloud platforms (AWS/Azure/GCP).
Preferred Certifications
- AWS Certified Data Analytics – Specialty
- Google Professional Data Engineer
- Databricks Certified Associate Developer for Apache Spark
Preferred Candidate Profile
- Strong problem-solving and analytical skills.
- Passion for building scalable, high-performance data solutions.
- Ability to work independently in Agile teams.
- Eagerness to learn emerging Big Data and cloud technologies.
📌 Software Engineer (Pune)
🏢 ICE
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.