Design and develop large-scale data processing pipelines using Java and Spark with AWS mandate. Build and maintain distributed applications utilizing Spark SQL, Spark Streaming, and DataFrames/Datasets.

Optimize

Spark jobs for performance, scalability, and resource utilization. Troubleshoot and resolve complex performance bottlenecks and production issues in a timely manner.

Qualifications: Bachelors degree in Computer Science Information Technology, or a related field 7 to10 years of experience in ava / Spark / AWS and Proven track record of delivering high-quality software solutions. Design and develop large-scale data processing pipelines and scalable microservices.

- Implement data integration solutions and ETL workflows.
- Write and maintain robust unit tests using JUnit 5, Mockito, and Cucumber.




- Collaborate with cross-functional teams to define and ship new features in a Scrum environment.). Proficiency in Java and strong experience with the Apache Spark ecosystem.
- Hands-on experience with Hadoop, Hive, and messaging systems like Apache Kafka.
- Deep understanding of distributed computing principles and AWS architecture (S3, EC2, Lambda, RDS). Experience with Splunk, Dynatrace, or Grafana for monitoring and observability.

- Excellent problem-solving skills and experience leading offshore teams in a technical capacity.

Experience in Agile Methodology

Preferred To Have Citi Process Knowledge

Valuable Communication Skills

📌 Senior Consultant (Chennai)
🏢 Virtusa
📍 Chennai