Kafka to AWS MSK Migration Engineer at N Consulting Ltd

Role: Kafka to AWS MSK Migration Engineer
Experience: 5+ years
Location: Bengaluru, Hyderabad

Roles and Responsibilities:

Technical Competencies

Candidates are not expected to be experts in every tool, but should bring strong hands-on experience across several of the following areas:

AWS Services: Hands-on experience with AWS compute and migration patterns, including ECS, EKS, Lambda, CloudWatch, and related cloud services.

Apache Kafka: Deep hands-on experience with Kafka architecture including brokers, topics, partitions, consumer groups, replication, and cluster operations.

AWS MSK: Practical experience with Amazon Managed Streaming for Apache Kafka including cluster provisioning, configuration, monitoring, and security (IAM, mTLS, SASL/SCRAM).

Migration Tooling: Experience with MirrorMaker 2, Confluent Replicator, or similar cross-cluster replication tools for data migration and offset synchronization.

Cloud Migration: Practical understanding of on-prem to cloud migration strategies, workload assessment,



testing, cutover, and post-migration validation.

Kafka Ecosystem: Familiarity with Schema Registry, Kafka Connect, Kafka Streams, and related ecosystem components.

Networking and Security: Understanding of VPC peering, PrivateLink, TLS encryption, IAM policies, and network connectivity patterns for hybrid Kafka architectures.

Programming and Automation: Experience with Python OR Java, Shell, or similar languages to build scripts, utilities, and automation frameworks for topic creation, ACL migration, and consumer group management.

Work experience CI/CD pipelines, Jenkins , Docker, Kuberneties

APIs and Integration: Working knowledge of RESTful APIs, API design, and API Gateway patterns.

CI/CD and Version Control: Robust experience with GitLab, Jenkins, Maven, or similar tools supporting automated build, test, and deployment pipelines.

Observability: Familiarity with monitoring, logging, alert

📌 AWS MSK Migration Engineer (Hyderabad)
🏢 N Consulting Global
📍 Hyderabad