Role & responsibilities
- Design, develop, and manage Kafka topics, partitions, schemas, and related configurations.
- Build and maintain Kafka producers/consumers, connectors, and streaming applications.
- Manage Kafka clusters, monitoring performance, throughput, and availability.
- Implement Kafka Connect (source/sink connectors) and Schema Registry
- Implement event-driven architecture (EDA) and integration design patterns.
- Ensure high availability, scalability, and fault tolerance across integration systems.
- Set up monitoring, logging, and alerting for Kafka & integration platforms (e.g., Prometheus, Grafana, Splunk, ELK).
- Collaborate with architecture, DevOps, and application teams for end-to-end delivery.
- Develop and maintain integration flows using messaging systems (Kafka, MQ, JMS, etc.).
- Implement enterprise API integrations, web services (REST/SOAP), and microservice communication patterns.
- Work with integration tools/frameworks such as Spring Integration, Apache Camel, MuleSoft, or similar.
- Troubleshoot and optimize distributed system performance issues.
Preferred candidate profile
- 3-6 years hands-on experience with Apache Kafka (brokers, producers, consumers, Connect, Streams).
- Solid knowledge of Kafka internals, partitions, replication, retention and consumer groups.
- Experience with Java / Spring Boot, or Python for building integration services.
- Solid understanding of integration patterns, message queues, and microservices.
- Experience with REST APIs, JSON, XML, and data serialization formats (Avro/Protobuf).
- Experience with Linux, shell scripting, and system troubleshooting.
- Familiarity with Git, CI/CD tools (Jenkins, GitLab, Azure DevOps, etc.).
📌 Kafka / Integration Engineer (New Delhi)
🏢 EY
📍 New Delhi