Location: Bengaluru

Experience: 5+ Years

Role Overview

We are looking for experienced Data Engineer to design, implement, and manage high-performance real-time streaming solutions using Apache Kafka, Apache Flink, and Java. The role focuses on building scalable event-driven architectures, managing cloud-native infrastructure, and ensuring secure, fault-tolerant streaming platforms that support enterprise-scale digital banking applications.

Key Responsibilities

Real-Time Data Engineering

Design, develop, and manage Kafka-based real-time streaming applications for high-throughput, low-latency environments.
Build scalable streaming data pipelines using Kafka Connect, ksqlDB, and Schema Registry.
Develop distributed streaming applications using Apache Flink and Java.
Optimize streaming architecture for performance, reliability, and scalability.

Platform & Infrastructure

Configure, administer, and optimize Kafka clusters for high availability and disaster recovery.




Automate infrastructure provisioning using Infrastructure-as-Code (Terraform).
Implement GitOps practices for deployment and configuration management.
Ensure robust platform security using SSL/mTLS, SASL, and ACLs.

Collaboration & Delivery

Work closely with Data Engineering, DevOps, Cloud, and Product teams.
Troubleshoot production issues and optimize streaming performance.
Maintain documentation and promote engineering best practices.
Participate in Agile delivery, sprint planning, and continuous improvement initiatives.

Required Skills

Apache Kafka
Apache Flink
Java
Kafka Connect
ksqlDB
Schema Registry
Terraform
GitOps
SSL/mTLS, SASL & ACLs
Distributed Streaming Architecture

Preferred Skills

Kubernetes
Docker
CI/CD Pipelines
AWS / Azure
Banking or Financial Services Experience

? Apply Now: [email protected]

📌 Data Engineer – Real-Time Streaming (Bengaluru)
🏢 D4 Insight
📍 Bengaluru