01 Sep
|
ATF LABS
|
Chhattisgarh
01 Sep
ATF LABS
Chhattisgarh
Position: Senior Data Engineer Location: REMOTEExperience: 5+ years About the Role: We are looking for a Senior Data Engineer with strong hands-on experience in Apache Spark, Scala, and Java, coupled with a solid understanding of microservices architecture. The ideal candidate will be a self-starter, able to design and implement scalable data pipelines and services in a distributed workplace.
Key Responsibilities: Design, build, and optimize scalable data pipelines using Apache Spark. Develop and maintain microservices in Scala/Java. Collaborate with cross-functional teams to define data requirements and delivery strategies.
Ensure high availability, performance, and security of data infrastructure. Implement caching strategies using Redis or similar distributed caching tools.
Requirements:5+ years of hands-on experience in data engineering.
Deep expertise in Apache Spark, Scala, and Java.
Experience designing and developing microservices-based architectures. Strong understanding of distributed systems and parallel processing. Working knowledge of Redis or equivalent distributed caching systems. Familiarity with CI/CD practices and cloud platforms is a plus.
Nice to Have: Experience with Kubernetes, Docker, or cloud-native environments. Exposure to data governance and quality frameworks.
📌 Senior Data Engineer (Chhattisgarh)
🏢 ATF LABS
📍 Chhattisgarh