Job Description: Big Data Developer (Spark Scala)

Position:
Big Data Developer

Experience:
5–7 years (relevant)

About the Role

We are looking for an experienced Big Data Developer with strong expertise in Apache Spark and Scala to design, build, and optimize large-scale data processing pipelines. The ideal candidate will have a solid background in distributed computing, big data ecosystems, and a collaborative mindset to work closely with cross-functional teams.

Key Responsibilities
Design, develop, and maintain scalable data processing pipelines using Apache Spark with Scala
Optimize Spark jobs for performance, including partitioning, caching, and resource tuning
Work with large-scale structured and unstructured datasets across distributed systems
Collaborate with data architects, analysts, and business stakeholders to understand requirements and translate them into technical solutions
Write clean, productive, and well-documented code following best engineering practices
Debug and resolve performance bottlenecks in big data jobs
Participate in code reviews,



design discussions, and sprint planning
Ensure data quality, consistency, and integrity across pipelines
Support production deployments and troubleshoot issues in live settings

Required Skills & Experience
5–7 years of overall IT experience, with substantial hands-on experience in Big Data development
Robust proficiency in
Apache Spark
and
Scala
(mandatory)
Solid understanding of distributed computing concepts (RDDs, DataFrames, Datasets, partitioning, shuffling)
Experience with Hadoop ecosystem components (HDFS, Hive, YARN, etc.)
Proficiency in SQL and working with large relational/non-relational datasets
Experience with performance tuning and optimization of Spark applications
Familiarity with version control systems (Git) and CI/CD pipelines
Strong problem-solving and analytical skills
Excellent verbal and written communication skills
— must be able to clearly arti

📌 Spark Scala Developer Hyderabad
🏢 Quess Corp
📍 Hyderabad