Role Overview

We are looking for a highly skilled
Kafka Migration Engineer
to join the
ETO Factory
team and support a high-visibility
on-premises Apache Kafka to AWS MSK migration project
.

The candidate will be responsible for
Kafka cluster discovery, workload assessment, capacity planning, AWS MSK configuration, migration execution, testing, validation, performance tuning, automation, and legacy Kafka cluster decommissioning
.

The ideal candidate should have solid hands-on experience with
Apache Kafka, AWS MSK, distributed messaging systems, cloud migration, Linux, programming, automation, and CI/CD
, along with the ability to collaborate with application, infrastructure, and platform teams.

Key Responsibilities
- Assess on-premises Kafka clusters and perform discovery across:
- Topics
- Partitions
- Consumer groups
- Throughput patterns
- Retention policies
- Inter-service dependencies
- Evaluate workloads based on:
- Message volume
- Business criticality
- Ordering requirements
- Latency requirements
- Consumer group complexity
- Determine appropriate




AWS MSK cluster placement, sizing, and configuration
.
- Plan and provision AWS MSK infrastructure, including:
- Broker sizing
- Storage
- Networking
- Security
- Execute
UAT and production parallel testing
using
MirrorMaker 2
or similar replication tools.
- Validate message delivery outcomes and troubleshoot migration discrepancies.
- Perform
Kafka/MSK performance tuning and optimization
to ensure scalability and production readiness.
- Collaborate with application, infrastructure, and platform teams to finalize:
- Migration plans
- Producer/consumer cutover strategies
- Validation criteria
- Rollback plans
- Execute production cutover activities, including:
- Consumer group migration
- Offset synchronization
- Post-release validation
- Support successful
decommissioning of legacy on-premises Kafka clusters
.
- Design and implement automation frameworks for repeatable, large-scale Kafka-to-MSK migrations.
- D

📌 Kafka Migration Engineer (India)
🏢 Deloitte
📍 India