Job Summary

We are looking for a Kafka Engineer with 2 to 5 years of experience to design, develop, and optimize high-throughput, low-latency data platforms. The ideal candidate will have hands-on expertise in Apache Kafka, Redis, and MongoDB, with a strong understanding of real-time event streaming, distributed caching, NoSQL databases, and performance optimization. You will work closely with application developers, DevOps engineers, and cross-functional teams to build scalable and resilient data solutions.

Key Responsibilities

Apache Kafka (Event Streaming & Messaging)
- Design, implement, and maintain high-throughput Kafka topics, partitions, and consumer groups.
- Configure Kafka producers and consumers for optimal performance and reliability.
- Ensure message delivery guarantees and manage schema evolution using Confluent Schema Registry.
- Monitor and troubleshoot Kafka clusters, consumer lag, and broker performance.

Redis (Distributed Caching & In-Memory Data Store)




- Design and implement efficient caching strategies to improve application performance and reduce database load.
- Utilize Redis data structures such as Hashes, Lists, Sets, Sorted Sets, HyperLogLogs, and Geospatial indexes.
- Configure and manage Redis Clusters, Sentinel deployments, Pub/Sub messaging, and persistence mechanisms.
- Optimize cache performance and resolve issues such as cache stampedes and memory fragmentation.

MongoDB (NoSQL Database)
- Design, implement, and optimize MongoDB databases, including Replica Sets and Sharded Clusters.
- Develop productive BSON document models while following MongoDB best practices.
- Build optimized indexes (Compound, Partial, and Text Indexes) to improve query performance.
- Develop complex aggregation pipelines and perform query optimization.

Performance Optimization & Modernization
- Profile and optimize end-to-end data flows across Kafka, Redis, and MongoDB.
- Identify and resolve system bottlenecks including slow queries, consumer lag, cachi

📌 Kafka Engineer (Thane)
🏢 3i Infotech
📍 Thane