01 Sep
|
ATF Labs
|
India
Position: Senior Data Engineer
Location:
REMOTE
Experience:
5+ years
About the Role:
We are looking for a
Senior Data Engineer
with solid hands-on experience in
Apache Spark, Scala, and Java
, coupled with a solid understanding of
microservices architecture . The ideal candidate will be a self-starter, able to design and implement scalable data pipelines and services in a distributed setting.
Key Responsibilities:
Design, build, and optimize scalable data pipelines
using Apache Spark .
Develop and maintain microservices in Scala/Java.
Collaborate with cross-functional teams to define data requirements and delivery strategies.
Ensure high availability, performance, and security of data infrastructure.
Implement caching strategies using Redis or similar distributed caching tools.
Requirements:
5+ years of hands-on experience in data engineering.
Deep expertise in
Apache Spark ,
Scala , and
Java .
Experience designing and developing
microservices-based architectures .
Robust understanding of distributed systems and parallel processing.
Working knowledge of
Redis
or equivalent distributed caching systems.
Familiarity with CI/CD practices and cloud platforms is a plus.
Nice to Have:
Experience with Kubernetes, Docker, or cloud-native environments.
Exposure to data governance and quality frameworks.
📌 Senior Data Engineer Mumbai (India)
🏢 ATF Labs
📍 India