Senior Confluent Kafka Developer

Role Summary

Handson developer responsible for building, configuring, testing, and supporting Kafkabased streaming pipelines, following defined architectural standards.

Common Requirement:

- 5+ years overall IT experience
- 5+ years on Kafka / Confluent platforms working on Kafka Core, KStream, KSQL, Kafka Connect.
- Certifications: CCDAK / CCAAK Preferred
- Soft Skills: Clear communication, documentation, ownership mindset
- Robust handson Kafka & Confluent experience.
- Java and/or Python based Kafka client development.
- Experience in regulated / BFSI environments preferred.
- Good understanding of data quality, replay, and recovery patterns.

Core Responsibilities

Kafka Core & Topics

- Create and manage Kafka topics with appropriate:
- Partitions, replication, retention, compaction

- Implement topiclevel security (ACLs / RBAC) and naming conventions.
- Work with Schema Registry for schema creation and evolution.

ksqlDB

- Develop and maintain:
- Streams, tables, persistent queries
- Joins, aggregations, windowing logic





- Handle error streams, DLQs, and reprocessing logic.

Kafka Streams

- Build Kafka Streams applications using KStreams DSL.
- Implement stateful and stateless transformations.
- Optimize performance and manage state stores.

Kafka Connect

- Configure and operate:
- Source connectors (RDBMS, IBM MQ, Files, APIs, CDC)
- Sink connectors (NoSQL, RDBMS, Cloud targets)

- Apply converters and Single Message Transforms (SMTs).
- Tune error handling, retries, DLQ behavior.

Custom Producers & Consumers

- Develop highthroughput producers and consumers using Java / Python.
- Implement idempotence, offset management, consumer groups.
- Build custom logic for enrichment, validation, decryption where required.

DevOps & Operations

- Use CI/CD pipelines to deploy:
- Topics, connectors, ksqlDB queries
- Kafka Streams applications

- Support monitoring and troubleshooting using Control Center / logs / metrics.

📌 Kafka Developer (Hyderabad)
🏢 Tata Consultancy Services
📍 Hyderabad