Position: Kafka Migration Engineer

Location: India, Remote

Day to day:

Insight Global is seeking a skilled Kafka Migration Engineer to support a large-scale migration from on-premises Apache Kafka to AWS MSK for a leading financial services firm. This individual will be responsible for assessing existing Kafka environments, performing discovery across topics, partitions, consumer groups, and application dependencies, and determining migration readiness. They will design and configure AWS MSK environments, analyse workloads to ensure appropriate cluster sizing and placement, and execute end-to-end migrations including testing, validation, performance tuning, and production cutovers.

The role will involve using MirrorMaker 2 and similar tooling to replicate and synchronise data between environments, troubleshooting migration issues, supporting post-migration validation, and decommissioning legacy Kafka infrastructure.

This engineer will also partner closely with application, infrastructure, and platform teams to deliver migrations safely at scale whilst building automation and repeatable processes to improve migration efficiency.

Must haves:

- 4+ years of hands-on experience with Apache Kafka , including brokers, topics, partitions, consumer groups, replication, and cluster administration.




- 4+ years of experience with AWS MSK , including cluster provisioning, configuration, monitoring, security, and production support.
- Solid experience with AWS cloud services , including EKS, ECS, Lambda, CloudWatch, and cloud migration patterns.
- Hands-on experience performing Kafka to AWS MSK migrations , including the use of MirrorMaker 2 (or similar replication tools) for data and offset synchronisation.
- Experience with Java, Python, Shell scripting , or similar languages for automation and tooling.
- Experience with REST APIs and system integrations.
- Experience with CI/CD tools such as GitLab, Jenkins, Maven, or similar.
- Linux/Unix administration and troubleshooting skills.
- Experience working within SDLC, change management, and Kubernetes-based environments .
- Excellent communication, troubleshooting, stakeholder management, and ownership mindset.

Plusses:

- Experience with Kafka Connect, Kafka Streams, and Schema Registry .
- Experience with monitoring and observability tools such as Prometheus, Grafana, Splunk , or similar.
- Experience designing automation frameworks to improve migration efficiency and scale.
- Experience within large-scale enterprise or financial services environments.

📌 Kafka Migration Engineer (India)
🏢 Insight Global
📍 India