Role Descriptions: Scala Spark Developer - Scala| Apache Spark (Core| SQL| DataFrames/Datasets)| HDFS| YARN

Experience Required: 6+ years

Location - PAN India

We are seeking a skilled Scala Spark Developer to design, develop, and support scalable big data processing solutions. The ideal candidate will have solid Scala programming expertise, hands-on experience with Apache Spark, and a solid understanding of distributed systems, Hadoop technologies, SQL, and data modeling.

Required Technical Skills

- Strong programming experience in Scala.
- Hands-on expertise with Apache Spark, including Spark Core, Spark SQL, DataFrames, and Datasets.
- Solid experience with the Hadoop ecosystem, particularly HDFS and YARN.
- Strong understanding of distributed systems and big data processing concepts.
- Experience working in Linux/Unix environments.
- Good knowledge of SQL and data modeling concepts.

Key Responsibilities

- Design, develop, test, and maintain scalable data processing applications using Scala and Apache Spark.




- Build efficient batch data pipelines using Spark Core, Spark SQL, DataFrames, and Datasets.
- Develop reusable, maintainable, and performance-optimized code for large-scale data processing.
- Work with Hadoop components, including HDFS for distributed storage and YARN for resource management.
- Analyze and optimize Spark jobs, SQL queries, data transformations, and cluster resource utilization.
- Design data structures and models that support efficient processing, reporting, and analytics.
- Troubleshoot application, data, and performance issues in distributed environments.
- Work in Linux/Unix environments to deploy, monitor, and support data processing jobs.
- Collaborate with data engineers, analysts, architects, and other stakeholders to translate requirements into reliable technical solutions.
- Follow coding, testing, documentation, and data quality best practices.

📌 IND_Analyst (Mumbai)
🏢 Artech Infosystems
📍 Mumbai