- Design, develop, test, deploy and maintain large-scale data processing pipelines using Scala/Spark.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Ensure high availability, scalability, security, and performance of software applications deployed on AWS cloud platform.
- Mentor junior engineers in best practices for coding standards, testing methodologies, and debugging techniques.
Job Requirements :
- 7-15 years of experience in software development with expertise in Scala/Spark programming languages.
- Solid understanding of big data technologies such as Apache Spark, Hadoop ecosystem (HDFS), Kafka messaging queues.
- Experience working with relational databases like PostgreSQL or Couchbase NoSQL database management systems.
- Proficiency in containerization using Docker/Kubernetes for deploying applications.