Key Responsibilities
- Assess on-prem Kafka clusters and perform discovery across topics, partitions, consumer groups, throughput patterns, retention policies, and inter-service dependencies to determine migration readiness.
- Analyze workloads based on message volume, business criticality, ordering guarantees, latency requirements, and consumer group complexity to determine appropriate MSK cluster placement and configuration.
- Plan and provision required AWS MSK infrastructure capacity including broker sizing, storage, networking, and security configurations to support migration, testing, and production execution.
- Execute UAT and production parallel testing using MirrorMaker 2 or similar replication tooling, compare message delivery outcomes, capture evidence, and troubleshoot discrepancies through closure.
- Perform performance tuning and optimization of MSK clusters to ensure migrated workloads are reliable, scalable, efficient, and production ready.
- Partner with application engineering, infrastructure, and platform teams to finalize migration plans,



consumer/producer cutover approach, validation criteria, and rollback considerations.
- Manage release readiness, execute production cutover activities including consumer group migration, offset synchronization, and complete post-release checkout and validation procedures.
- Support legacy on-premises Kafka cluster decommissioning after successful migration and validation.
- Design, enhance, and implement automation frameworks and AI-assisted solutions to enable repeatable, efficient, large-scale Kafka-to-MSK migrations.
- Document migration procedures, operational learnings, risks, and best practices to improve the factory execution model.

Technical Competencies

Candidates are not expected to be experts in every tool, but should bring strong hands-on experience across several of the following areas:
- AWS Services: Hands-on experience with AWS compute and migration patterns, including ECS, EKS, Lambda, CloudWat

📌 Kafka Engineer (Bengaluru)
🏢 Insight Global
📍 Bengaluru