We are looking for an experienced Kafka Data Engineer with strong hands-on expertise in Apache Kafka, Kafka Topic/Cluster Migration, Data Streaming, and Distributed Systems. The candidate will be responsible for planning and executing Kafka migrations, cluster-to-cluster replication, data validation, performance tuning, and ensuring minimal downtime during migration activities.

Key Responsibilities

Design and execute Kafka topic and cluster migrations across environments, clusters, or cloud platforms.
Perform Kafka cluster upgrades, broker migrations, and data replication using MirrorMaker 2.0, Confluent Replicator, Cluster Linking, or similar technologies.
Migrate and validate topics, schemas, consumer groups, offsets, ACLs, and configurations.
Monitor Kafka throughput, latency, consumer lag, partition health, and overall cluster performance.
Troubleshoot Kafka connectivity, replication, partition balancing, and consumer lag issues.
Develop automation scripts using Python, Shell scripting, Java, or Scala.
Work with application teams to validate producers, consumers,



and streaming pipelines after migration.
Implement Kafka security using SSL/TLS, SASL, Kerberos, RBAC, and ACLs.
Collaborate with DevOps, Cloud, and Data Engineering teams for infrastructure and deployment activities.
Prepare migration plans, rollback strategies, technical documentation, and post-migration reports.

Mandatory Skills

Robust hands-on experience with Apache Kafka Administration and Development.
Proven experience in Kafka Topic Migration / Cluster Migration / Cross-Cluster Replication.
Hands-on experience with MirrorMaker 2.0, Confluent Replicator, or Cluster Linking.
Robust knowledge of Kafka Connect, Kafka Streams, Schema Registry, and Confluent Platform.
Positive understanding of Kafka partitions, brokers, replication, consumer groups, offsets, and consumer lag.
Experience working in Linux/Unix environments.
Proficiency in Python, Java, or Scala.
Strong understanding of distributed system

📌 Kafka Data Engineer 5+ Years Hyderabad
🏢 Zorba AI
📍 Hyderabad