We are looking for an experienced Scala and Spark Data Engineer with strong expertise in Scala functional programming and distributed data processing. The ideal candidate should have hands-on experience developing scalable data engineering solutions using Scala and Apache Spark.
Candidates must demonstrate strong functional programming concepts and practical coding skills.
Experience limited to Scala implementation, maintenance, or debugging will not be sufficient.
Key Skills
- Strong Scala functional programming
- Apache Spark
- Data Engineering
- SQL
- Functional programming concepts, immutability and pure functions
- Higher-order functions and Scala collections
- Option, Some and None
- Case classes and pattern matching
- Spark DataFrames, Datasets and RDDs
- Narrow and wide transformations
- Repartitioning and coalescing
- Distributed data processing and performance optimization
Roles and Responsibilities
- Design,
develop and maintain scalable data processing applications using Scala and Spark.
- Implement data pipelines and distributed processing solutions.
- Apply functional programming principles to develop clean, reusable and maintainable code.
- Optimize Spark jobs for performance and scalability.
- Work with structured data and SQL-based transformations.
- Troubleshoot performance issues and ensure data processing reliability.
- Collaborate with cross-functional teams to deliver data engineering solutions.
- Participate in technical discussions, code reviews and solution design.
Mandatory Candidate Criteria
- Strong hands-on experience in Scala functional programming.
- Good working knowledge of Apache Spark.
- Robust understanding of SQL.
- Ability to explain functional programming concepts and demonstrate coding knowledge.
- Candidates whose Scala experience is limited to implementation or debugging are not suitable.
Interview Process
- 1 internal technical round
- 2 client rounds
- An additional client round or face-to-face interview may be required.
📌 Scala and Spark Data Engineer (Mumbai)
🏢 SWITS DIGITAL Private
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.