Position: Kafka Migration Engineer

Location: India, Remote

Day to day:

Insight Global is seeking a skilled Kafka Migration Engineer to support a large-scale migration from on-premises Apache Kafka to AWS MSK for a leading financial services firm. This individual will be responsible for assessing existing Kafka environments, performing discovery across topics, partitions, consumer groups, and application dependencies, and determining migration readiness. They will design and configure AWS MSK environments, analyse workloads to ensure appropriate cluster sizing and placement, and execute end-to-end migrations including testing, validation, performance tuning, and production cutovers. The role will involve using
MirrorMaker 2
and similar tooling to replicate and synchronise data between environments, troubleshooting migration issues, supporting post-migration validation, and decommissioning legacy Kafka infrastructure. This engineer will also partner closely with application, infrastructure,



and platform teams to deliver migrations safely at scale whilst building automation and repeatable processes to improve migration efficiency.

Must haves:
- 4+ years of hands-on experience with
Apache Kafka
, including brokers, topics, partitions, consumer groups, replication, and cluster administration.
- 4+ years of experience with
AWS MSK
, including cluster provisioning, configuration, monitoring, security, and production support.
- Robust experience with
AWS cloud services
, including EKS, ECS, Lambda, CloudWatch, and cloud migration patterns.
- Hands-on experience performing
Kafka to AWS MSK migrations
, including the use of
MirrorMaker 2
(or similar replication tools) for data and offset synchronisation.
- Experience with
Java, Python, Shell scripting
, or similar languages for automation and tooling.
- Experience with
REST APIs
and system integrations.
- Experience with
CI/CD tools
such as GitLab, Jenkins, Maven, or similar.
- Linux/Unix administration and troubleshootin

📌 Kafka Migration Engineer (India)
🏢 Insight Global
📍 India