Role Descriptions: Scala Spark Developer - Scala| Apache Spark (Core| SQL| DataFrames/Datasets)| HDFS| YARN

Experience Required: 6+ years

Location - PAN India

We are seeking a skilled Scala Spark Developer to design, develop, and support scalable big data processing solutions. The ideal candidate will have solid Scala programming expertise, hands-on experience with Apache Spark, and a solid understanding of distributed systems, Hadoop technologies, SQL, and data modeling.

Required Technical Skills
Strong programming experience in Scala.
Hands-on expertise with Apache Spark, including Spark Core, Spark SQL, DataFrames, and Datasets.
Solid experience with the Hadoop ecosystem, particularly HDFS and YARN.
Solid understanding of distributed systems and big data processing concepts.
Experience working in Linux/Unix environments.
Valuable knowledge of SQL and data modeling concepts.

Key Responsibilities
Design, develop, test, and maintain scalable data processing applications using Scala and Apache Spark.




Build productive batch data pipelines using Spark Core, Spark SQL, DataFrames, and Datasets.
Develop reusable, maintainable, and performance-optimized code for large-scale data processing.
Work with Hadoop components, including HDFS for distributed storage and YARN for resource management.
Analyze and optimize Spark jobs, SQL queries, data transformations, and cluster resource utilization.
Design data structures and models that support efficient processing, reporting, and analytics.
Troubleshoot application, data, and performance issues in distributed environments.
Work in Linux/Unix environments to deploy, monitor, and support data processing jobs.
Collaborate with data engineers, analysts, architects, and other stakeholders to translate requirements into reliable technical solutions.
Follow coding, testing, documentation, and data quality best practices.

📌 Ind Analyst Mumbai
🏢 Artech Infosystems
📍 Mumbai