02 Sep
|
Deloitte
|
Bengaluru
02 Sep
Deloitte
Bengaluru
The team
Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning
Your work profile
We are seeking a highly skilled Kafka Migration Engineer to join the ETO Factory team and support a high-visibility on-prem Apache Kafka to AWS MSK migration project. This role will focus on cluster discovery, topic mapping, capacity planning, platform configuration, migration execution, validation, performance tuning, automation, and legacy cluster decommissioning.
The ideal candidate will bring robust hands-on engineering experience with distributed messaging systems, a structured delivery mindset, and the ability to collaborate effectively with application, infrastructure, and platform teams to execute migrations safely and at scale.
Key skills required:
Assess on-prem Kafka clusters and perform discovery across topics, partitions, consumer groups, throughput patterns, retention policies, and inter-service dependencies to determine migration readiness.
▪Analyze workloads based on message volume, business criticality, ordering guarantees, latency requirements, and consumer group complexity to determine appropriate MSK cluster placement and configuration.
▪Plan and provision required AWS MSK infrastructure capacity including broker sizing, storage, networking, and security configurations to support migration, testing, and production execution.
▪Execute UAT and production parallel testing using MirrorMaker 2 o
📌 AWS + Kafka + Java/Python (Bengaluru)
🏢 Deloitte
📍 Bengaluru