We are looking for a hands-on Kafka Administrator to own the health, performance and security of our streaming platform. You will manage production Kafka clusters handling , work closely with data engineering and application teams, and drive automation across provisioning, monitoring and upgrades.

Key Responsibilities

- Install, configure, upgrade and administer Apache Kafka / Confluent Kafka clusters across Dev, UAT and Production environments

- Manage topics, partitions, replication factors, retention policies and consumer groups; handle partition rebalancing and broker scaling

- Implement and maintain cluster security SASL/SCRAM, Kerberos, SSL/TLS encryption, ACLs and role-based access control

- Monitor cluster health using Prometheus, Grafana, Confluent Control Center or Burrow; set up alerting for consumer lag, under-replicated partitions and broker failures

- Troubleshoot production issues ISR shrink, consumer lag spikes, disk pressure, JVM/GC tuning, network bottlenecks

- Administer the wider ecosystem: Kafka Connect, Schema Registry, ksqlDB,



Mirror Maker 2 / Cluster Linking for replication and DR

- Perform capacity planning, benchmarking and performance tuning of brokers, producers and consumers

- Automate provisioning and routine operations using Ansible / Terraform and Shell / Python scripting

- Support Zookeeper-to-Kraft migration and version upgrades with zero or minimal downtime

- Define and maintain backup, disaster recovery and runbook documentation; participate in on-call rotation

Must-Have Skills

- 5+ years of hands-on Kafka administration in production environments

- Robust Linux/Unix administration and shell scripting

- Solid understanding of Kafka internals — offsets, log compaction, ISR, leader election, rebalance protocols

- Experience with Kafka security (SSL, SASL, Kerberos, ACLs)

- Monitoring and observability tooling (Prometheus, Grafana, JMX, ELK)

- JVM tuning and troubleshooting

📌 Kafka Administrator (Bengaluru)
🏢 Capgemini
📍 Bengaluru