Job Description:

- Assess and analyze on-prem Kafka clusters, including topics, partitions, consumer groups, throughput, retention, and dependencies.

- Plan Kafka-to-AWS MSK migration strategy, cluster sizing, capacity, storage, networking, and security.

- Provision and configure AWS MSK clusters for UAT and production workloads.

- Execute data migration using MirrorMaker 2, Confluent Replicator, or similar tools.

- Perform UAT and parallel testing, validate message delivery, offsets, ordering, and consumer behavior.

- Troubleshoot migration issues and perform Kafka/MSK performance tuning and optimization.

- Coordinate with application, infrastructure, and platform teams for cutover, rollback, and release readiness.





- Execute production consumer/producer cutover and offset synchronization.

- Conduct post-migration validation and ensure migrated workloads are secure and production-ready.

- Automate migration activities such as topic creation, ACL migration, consumer group management, and validation using Python/Java/Shell.

- Monitor Kafka/MSK using CloudWatch, Prometheus, Grafana, Splunk, or similar tools.

- Support decommissioning of legacy on-prem Kafka clusters after successful migration.

- Document migration procedures, risks, issues, lessons learned, and best practices for repeatable migration execution.

📌 Kafka Migration Engineer (Bengaluru)
🏢 Acme Services Private
📍 Bengaluru