19 Aug
|
N Consulting
|
India
19 Aug
N Consulting
India
Role: Kafka to AWS MSK Migration Engineer
Experience: 5+ years
Location: Bengaluru, Hyderabad
Roles and Responsibilities:
Technical Competencies
Candidates are not expected to be experts in every tool, but should bring solid hands-on experience across several of the following areas:
▪ AWS Services: Hands-on experience with AWS compute and migration patterns, including ECS, EKS, Lambda, Cloud Watch, and related cloud services.
▪ Apache Kafka: Deep hands-on experience with Kafka architecture including brokers, topics, partitions, consumer groups, replication, and cluster operations.
▪ AWS MSK: Practical experience with Amazon Managed Streaming for Apache Kafka including cluster provisioning, configuration, monitoring, and security (IAM, mTLS, SASL/SCRAM).
▪ Migration Tooling: Experience with Mirror Maker 2, Confluent Replicator, or similar cross-cluster replication tools for data migration and offset synchronization.
▪ Cloud Migration: Practical understanding of on-prem to cloud migration strategies, workload assessment, testing, cutover, and post-migration validation.
▪ Kafka Ecosystem: Familiarity with Schema Registry, Kafka Connect, Kafka Streams, and related ecosystem components.
▪ Networking and Security: Understanding of VPC peering, Private Link, TLS encryption, IAM policies, and network connectivity patterns for hybrid Kafka architectures.
▪ Programming and Automation: Experience with Python OR Java, Shell, or similar languages to build scripts, utilities, and automation frameworks for topic creation, ACL migration, and consumer group management.
Work experience CI/CD pipelines, Jenkins , Docker, Kuberneties
▪ APIs and Integration: Working knowledge of RESTful APIs, API design, and API Gateway patterns.
▪ CI/CD and Version Control: Strong experience with Git Lab, Jenkins, Maven, or similar tools supporting automated build, test, and deployment pipelines.
▪ Observability: Familiarity with monitoring, logging, alerting, and troubleshooting using tools such as Cloud Watch, Prometheus, Grafana, Splunk, or equivalent platforms for Kafka/MSK cluster health.
▪ Automation Excellence: Ability to design repeatable automation and apply AI-assisted engineering approaches to improve migration scale, quality, and efficiency.
📌 Kafka to AWS MSK Migration Engineer (India)
🏢 N Consulting
📍 India