13 Nov
|
Cloud Raptor
|
Bengaluru
13 Nov
Cloud Raptor
Bengaluru
Data Engineer
We are hiring an experienced Data Engineer to design, build, and maintain scalable real-time data platforms. The ideal candidate should have strong experience in backend engineering, stream processing, distributed systems, and cloud-based data architectures, with expertise in Kafka, Flink, Spark, JVM technologies, and Python.
Key Skills
Apache Kafka, Apache Flink, Spark, Java, Kotlin, Scala, Python, SQL, ETL, Stream Processing, Real-Time Data Pipelines, REST APIs, gRPC, WebSockets, AWS, Kubernetes, Docker, CI/CD
Responsibilities
- Design and implement middleware and backend systems capable of handling high-throughput workloads.
- Develop and maintain stream processing applications using Apache Flink.
- Build and optimize scalable ETL jobs and real-time data pipelines.
- Monitor, troubleshoot, and improve platform performance, reliability, and scalability.
- Support migration initiatives from on-premises Kafka environments to cloud platforms.
- Collaborate with Business Intelligence and Product teams to deliver actionable data insights.
- Contribute to the architecture and evolution of cloud-based streaming data platforms.
Requirements
- 5+ years of software development and backend engineering experience.
- Robust programming skills in Java, Kotlin, Scala, and Python.
- Hands-on experience with Apache Kafka, Apache Flink, Spark, and SQL.
- Experience building ETL solutions, stream processing applications, and batch data pipelines.
- Strong understanding of distributed systems, concurrency, fault tolerance, and high-availability architectures.
- Experience with REST APIs, JSON, gRPC, and WebSockets.
- Knowledge of JSON, Avro, and Protobuf data formats.
- Familiarity with Git and CI/CD practices.
- Strong communication and collaboration skills with experience working in distributed teams.
Good to Have
- Experience with AWS services such as MSK, OpenSearch, and EKS.
- Hands-on experience with Kubernetes and Docker.
- Knowledge of cloud-native deployment and monitoring practices.
- Experience working on large-scale streaming and event-driven architectures.
If you are passionate about building high-performance data platforms, real-time streaming solutions, and scalable cloud-based architectures, we'd love to hear from you.
📌 Data Engineer (Bengaluru)
🏢 Cloud Raptor
📍 Bengaluru