Job DescriptionKey Responsibilities

N▪

nAssess on-prem Kafka clusters and perform discovery across topics, partitions, consumer groups, throughput patterns, retention policies, and inter-service dependencies to determine migration readiness.

N▪

nAnalyze workloads based on message volume, business criticality, ordering guarantees, latency requirements, and consumer group complexity to determine appropriate MSK cluster placement and configuration.

N▪

nPlan and provision required AWS MSK infrastructure capacity including broker sizing, storage, networking, and security configurations to support migration, testing, and production execution.

N▪

nExecute UAT andproduction parallel testing using MirrorMaker 2 or similar replication tooling, compare message delivery outcomes, capture evidence, and troubleshoot discrepancies through closure.

N▪

nPerform performance tuning and optimization of MSK clusters to ensure migrated workloads are stable, scalable, efficient, and production ready.

N▪

nPartner with application engineering, infrastructure, and platform teams to finalize migration plans, consumer/producer cutover approach, validation criteria, and rollback considerations.

N▪

nManage release readiness, execute production cutover activities including consumer group migration, offset synchronization, and complete post-release checkout and validation procedures.

N▪

nSupport legacy on-premises Kafka cluster decommissioning after successful migration and validation.

N▪

nDesign, enhance, and implement automation frameworks and AI-assisted solutions to enable repeatable, efficient, large-scale Kafka-to-MSK migrations.

N▪

nDocument migration procedures, operational learnings, risks, and best practices to improve the factory execution model.

NRequired Qualifications

NBasic Qualifications

n▪

NEducation: Bachelor's or Master's degree in Computer Science, Engineering, Applied Mathematics,



or a related quantitative discipline.

N▪

nExperience: 3–5 years of hands-on engineering experience in a collaborative, team-based environment with distributed messaging systems.

N▪

nProgramming: Professional proficiency in Python, Java, or a similar programming/scripting language.

N▪

nSystems: Robust Unix/Linux fundamentals with the ability to troubleshoot application, deployment, environment, and runtime issues.

N▪

nMethodology: Familiarity with SDLC practices, CI/CD delivery models, change management, and Kubernetes-based deployments.

NTechnical Competencies

NCandidates are not expected to be experts in every tool, but should bring strong hands-on experience across several of the following areas:

N▪

nAWS Services: Hands-on experience with AWS compute and migration patterns, including ECS, EKS, Lambda, CloudWatch, and related cloud services.

N▪

nApache Kafka: Deep hands-on experience with Kafka architecture including brokers, topics, partitions, consumer groups, replication, and cluster operations.

N▪

nAWS MSK: Practical experience with Amazon Managed Streaming for Apache Kafka including cluster provisioning, configuration, monitoring, and security (IAM, mTLS, SASL/SCRAM).

N▪

nMigration Tooling: Experience with MirrorMaker 2, Confluent Replicator, or similar cross-cluster replication tools for data migration and offset synchronization.

N▪

nCloud Migration: Practical understanding of on-prem to cloud migration strategies, workload assessment, testing, cutover, and post-migration validation.





N▪

nKafka Ecosystem: Familiarity with Schema Registry, Kafka Connect, Kafka Streams, and related ecosystem components.

N▪

nNetworking and Security: Understanding of VPC peering, PrivateLink, TLS encryption, IAM policies, and network connectivity patterns for hybrid Kafka architectures.

N▪

nProgramming andAutomation: Experience with Python, Java, Shell, or similar languages to build scripts, utilities, and automation frameworks for topic creation, ACL migration, and consumer group management.

N▪

nAPIs and Integration: Working knowledge of RESTful APIs, API design, and API Gateway patterns.

N▪

nCI/CD and Version Control: Strong experience with GitLab, Jenkins, Maven, or similar tools supporting automated build, test, and deployment pipelines.

N▪

nObservability: Familiarity with monitoring, logging, alerting, and troubleshooting using tools such as CloudWatch, Prometheus, Grafana, Splunk, or equivalent platforms for Kafka/MSK cluster health.

N▪

nAutomation Excellence: Ability to design repeatable automation and apply AI-assisted engineering approaches to improve migration scale, quality, and efficiency.

NCore Competencies

n▪

NExceptional analytical, troubleshooting, and debugging skills.

N▪

nStrong ownership mindset with the ability to drive work to closure and meet commitments.

N▪

nClear written and verbal communication, including concise status updates, structured briefings, and proactive stakeholder management.

N▪

nEffective collaboration across application, infrastructure, platform, and global engineering teams.

N▪

nAbility to workconstructively across time zones, build alignment, and resolve issues with urgency and professionalism.

N▪

nStrong integrity, sound judgment, and commitment to good conduct and ethical decision-making.

N▪

nHigh energy,

📌 Kafka To Aws Msk Migration Engineer (Bengaluru)
🏢 Lorven Technologies
📍 Bengaluru