17 Nov
|
Tata Consultancy Services
|
Chennai
17 Nov
Tata Consultancy Services
Chennai
Hiring: Apache Spark & Scala Developer
Location: Chennai ,
Experience: 4-8Years
Interview Mode: Virtual
Interview Date: To Be Announced
Job Summary
We are looking for a skilled Apache Spark & Scala Developer with hands-on experience in building scalable data processing applications and big data solutions. The ideal candidate should have expertise in Scala programming, Apache Spark, and distributed data processing frameworks, with the ability to develop and optimize high-performance data pipelines.
Ideal Candidate:
- Strong experience in Scala programming.
- Hands-on experience with Apache Spark (Core, SQL, DataFrames, Spark Streaming).
- Valuable understanding of distributed computing concepts.
- Experience working with Hive, HDFS, Kafka, or Hadoop ecosystem.
- Knowledge of SQL and data modeling concepts.
- Experience with Unix/Linux environments and shell scripting.
- Understanding of ETL processes and data warehousing concepts.
- Familiarity with Git and CI/CD processes.
Key Responsibilities
- Design, develop, and maintain large-scale data processing applications using Apache Spark and Scala.
- Build and optimize batch and real-time data pipelines.
- Perform data transformation, cleansing, and integration from multiple data sources.
- Develop reusable, scalable, and efficient Spark applications.
- Monitor and troubleshoot Spark jobs to ensure performance and reliability.
- Collaborate with data engineers, architects, and business teams to understand requirements.
- Optimize Spark workloads, memory usage, and cluster performance.
- Ensure adherence to coding standards, best practices, and security guidelines.
📌 Scala Developer (Chennai)
🏢 Tata Consultancy Services
📍 Chennai