Location: Bengaluru
Experience: 5+ Years

Role Overview:

We are looking for experienced Data Engineer to design, implement, and manage high-performance real-time streaming solutions using Apache Kafka, Apache Flink, and Java. The role focuses on building scalable event-driven architectures, managing cloud-native infrastructure, and ensuring secure, fault-tolerant streaming platforms that support enterprise-scale digital banking applications.

Key Responsibilities:

Real-Time Data Engineering

- Design, develop, and manage Kafka-based real-time streaming applications for high-throughput, low-latency environments.
- Build scalable streaming data pipelines using Kafka Connect, ksqlDB, and Schema Registry.
- Develop distributed streaming applications using Apache Flink and Java.
- Optimize streaming architecture for performance, reliability, and scalability.

Platform & Infrastructure

- Configure, administer, and optimize Kafka clusters for high availability and disaster recovery.




- Automate infrastructure provisioning using Infrastructure-as-Code (Terraform).
- Implement GitOps practices for deployment and configuration management.
- Ensure robust platform security using SSL/mTLS, SASL, and ACLs.

Collaboration & Delivery

- Work closely with Data Engineering, DevOps, Cloud, and Product teams.
- Troubleshoot production issues and optimize streaming performance.
- Maintain documentation and promote engineering best practices.
- Participate in Agile delivery, sprint planning, and continuous improvement initiatives.

Required Skills:

- Apache Kafka
- Apache Flink
- Java
- Kafka Connect
- ksqlDB
- Schema Registry
- Terraform
- GitOps
- SSL/mTLS, SASL & ACLs
- Distributed Streaming Architecture

Preferred Skills:

- Kubernetes
- Docker
- CI/CD Pipelines
- AWS / Azure
- Banking or Financial Services Experience

Apply Now: [email protected]

📌 Data Engineer – Real-Time Streaming (Flink / Java / Kafka) (India)
🏢 D4 Insight
📍 India