- Design, develop, test, deploy and maintain large-scale data processing pipelines using Apache Spark, Hadoop, Kafka on AWS.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop high-quality code in Java to ensure scalability, performance, and reliability of the system.
- Troubleshoot issues related to big data processing workflows and optimize system resources for improved efficiency.
Job Requirements :
- 5-13 years of experience in software development with expertise in Java programming language.
- Robust understanding of Apache Spark, Hadoop, Kafka technologies and their applications in big data processing.
- Experience working with cloud-based platforms such as AWS is required.