Roles and Responsibilities :

- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions.

- Collaborate with cross-functional teams to gather requirements and design ETL processes for complex datasets.

- Develop high-quality code in Java to process large volumes of data from various sources including Kafka.

- Troubleshoot issues related to pipeline failures and optimize performance for improved efficiency.

Job Requirements :

- 4-9 years of experience in software development with a focus on big data processing technologies like Apache Spark or Hadoop.

- Solid understanding of AWS services including S3, Lambda, Step Functions etc. .

- Proficiency in developing scalable Java applications for handling large-scale data processing tasks.

- Experience working with messaging queues like Kafka.

📌 Data Engineering (Bengaluru)
🏢 Virtusa
📍 Bengaluru