Role Descriptions: Scala Spark Developer - Scala| Apache Spark (Core| SQL| DataFrames/Datasets)| HDFS| YARN

Experience Required: 6+ years

Location - PAN India

We are seeking a skilled Scala Spark Developer to design, develop, and support scalable big data processing solutions. The ideal candidate will have strong Scala programming expertise, hands-on experience with Apache Spark, and a solid understanding of distributed systems, Hadoop technologies, SQL, and data modeling.

Required Technical Skills

• Strong programming experience in Scala.

• Hands-on expertise with Apache Spark, including Spark Core, Spark SQL, DataFrames, and Datasets.

• Solid experience with the Hadoop ecosystem, particularly HDFS and YARN.

• Strong understanding of distributed systems and big data processing concepts.

• Experience working in Linux/Unix environments.

• Positive knowledge of SQL and data modeling concepts.

Key Responsibilities

• Design, develop, test, and maintain scalable data processing applications using Scala and Apache Spark.





• Build efficient batch data pipelines using Spark Core, Spark SQL, DataFrames, and Datasets.

• Develop reusable, maintainable, and performance-optimized code for large-scale data processing.

• Work with Hadoop components, including HDFS for distributed storage and YARN for resource management.

• Analyze and optimize Spark jobs, SQL queries, data transformations, and cluster resource utilization.

• Design data structures and models that support efficient processing, reporting, and analytics.

• Troubleshoot application, data, and performance issues in distributed environments.

• Work in Linux/Unix environments to deploy, monitor, and support data processing jobs.

• Collaborate with data engineers, analysts, architects, and other stakeholders to translate requirements into reliable technical solutions.

• Follow coding, testing, documentation, and data quality best practices.

📌 IND_Analyst (Mumbai)
🏢 Artech Infosystems
📍 Mumbai