Key Responsibilities
Develop and optimize large-scale data processing applications using Scala, PySpark and Java.
Write clean, reusable and efficient Scala code.
Apply functional programming concepts while solving coding problems.
Develop Spark applications using Spark DataFrames and Spark SQL.
Write Scala-based Spark DataFrame transformations.
Understand and explain Spark execution from an architectural perspective.
Identify Spark transformations and actions.
Estimate the number of Spark jobs and stages created for a given Spark program.
Understand Spark DAG, lazy evaluation and execution plans.
Work with Spark deployment modes, including client mode and cluster mode.
Troubleshoot and optimize Spark applications.
Independently understand problem statements and convert them into technical solutions.
Collaborate with technical teams and stakeholders to deliver effective solutions.
Mandatory Technical Skills
Robust hands-on experience in Scala development.
Robust understanding of Scala functional programming.
Hands-on experience with Apache Spark.
Experience writing Spark DataFrame transformations.
Good knowledge of Spark Core, Spark SQL and RDDs.
Working experience with PySpark.
Good knowledge of Core Java.
Strong coding, analytical and problem-solving skills.
Ability to understand requirements independently.
Robust Scala Knowledge Is Essential Candidates should be comfortable working with concepts such as: Case Classes | Higher-Order Functions | Currying | Partial Functions | Option/Some/None | Pattern Matching | Collections | Immutability | Functional Programming Important: This is a Scala-focused development role . Candidates with primarily Python/PySpark experience and limited hands-on Scala coding experience may not be suitable.
If you are a Scala developer who enjoys solving complex problems and building high-scale Spark applications, we would be interested in hearing from you.
Food For Thought Big data is not just about processing more data. It is about writing smarter code that can scale with it.
📌 Spark Hadoop Developer Mumbai
🏢 Three Across
📍 Mumbai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.