Key Responsibilities

▪

Assess on-prem Kafka clusters and perform discovery across topics, partitions, consumer groups, throughput patterns, retention policies, and inter-service dependencies to determine migration readiness.

▪

Analyze workloads based on message volume, business criticality, ordering guarantees, latency requirements, and consumer group complexity to determine appropriate MSK cluster placement and configuration.

▪

Plan and provision required AWS MSK infrastructure capacity including broker sizing, storage, networking, and security configurations to support migration, testing, and production execution.

▪

Execute UAT and production parallel testing using MirrorMaker 2 or similar replication tooling, compare message delivery outcomes, capture evidence, and troubleshoot discrepancies through closure.

▪

Perform performance tuning and optimization of MSK clusters to ensure migrated workloads are secure, scalable, effective, and production ready.

▪

Partner with application engineering, infrastructure, and platform teams to finalize migration plans,



consumer/producer cutover approach, validation criteria, and rollback considerations.

▪

Manage release readiness, execute production cutover activities including consumer group migration, offset synchronization, and complete post-release checkout and validation procedures.

▪

Support legacy on-premises Kafka cluster decommissioning after successful migration and validation.

▪

Design, enhance, and implement automation frameworks and AI-assisted solutions to enable repeatable, efficient, large-scale Kafka-to-MSK migrations.

▪

Document migration procedures, operational learnings, risks, and best practices to improve the factory execution model.

Required Qualifications

Basic Qualifications

▪

Education: Bachelor's or Master's degree in Computer Science, Engineering, Applied Mathematics, or a related quantitative discipline.

▪

Experience: 3–5 years of hands-on engineering experience in a collabo

📌 Kafka to AWS MSK Migration Engineer (Bengaluru)
🏢 Lorven Technologies
📍 Bengaluru