Design and develop large-scale data processing pipelines using Java and Spark with AWS mandate. Build and maintain distributed applications utilizing Spark SQL, Spark Streaming, and DataFrames/Datasets.

Optimize

Spark jobs for performance, scalability, and resource utilization. Troubleshoot and resolve complex performance bottlenecks and production issues in a timely manner.

Qualifications: Bachelors degree in Computer Science Information Technology, or a related field 7 to10 years of experience in ava / Spark / AWS and Proven track record of delivering high-quality software solutions. Design and develop large-scale data processing pipelines and scalable microservices.
Implement data integration solutions and ETL workflows.
Write and maintain robust unit tests using JUnit 5, Mockito, and Cucumber.




Collaborate with cross-functional teams to define and ship current features in a Scrum environment.). Proficiency in Java and robust experience with the Apache Spark ecosystem.
Hands-on experience with Hadoop, Hive, and messaging systems like Apache Kafka.
Deep understanding of distributed computing principles and AWS architecture (S3, EC2, Lambda, RDS). Experience with Splunk, Dynatrace, or Grafana for monitoring and observability.
Excellent problem-solving skills and experience leading offshore teams in a technical capacity.

Experience in Agile Methodology

Preferred To Have Citi Process Knowledge

Valuable Communication Skills

📌 Lead Software Engineer Chennai
🏢 Virtusa
📍 Chennai