Senior Confluent Kafka Developer

Role Summary

Handson developer responsible for building, configuring, testing, and supporting Kafkabased streaming pipelines, following defined architectural standards.

Common Requirement:
5+ years overall IT experience
5+ years on Kafka / Confluent platforms working on Kafka Core, KStream, KSQL, Kafka Connect.
Certifications: CCDAK / CCAAK Preferred
Soft Skills: Transparent communication, documentation, ownership mindset
Robust handson Kafka & Confluent experience.
Java and/or Python based Kafka client development.
Experience in regulated / BFSI settings preferred.
Good understanding of data quality, replay, and recovery patterns.

Core Responsibilities

Kafka Core & Topics
Create and manage Kafka topics with appropriate:
Partitions, replication, retention, compaction
Implement topiclevel security (ACLs / RBAC) and naming conventions.
Work with Schema Registry for schema creation and evolution.

ksqlDB
Develop and maintain:
Streams, tables, persistent queries
Joins, aggregations, windowing logic




Handle error streams, DLQs, and reprocessing logic.

Kafka Streams
Build Kafka Streams applications using KStreams DSL.
Implement stateful and stateless transformations.
Optimize performance and manage state stores.

Kafka Connect
Configure and operate:
Source connectors (RDBMS, IBM MQ, Files, APIs, CDC)
Sink connectors (NoSQL, RDBMS, Cloud targets)
Apply converters and Single Message Transforms (SMTs).
Tune error handling, retries, DLQ behavior.

Custom Producers & Consumers
Develop highthroughput producers and consumers using Java / Python.
Implement idempotence, offset management, consumer groups.
Build custom logic for enrichment, validation, decryption where required.

DevOps & Operations
Use CI/CD pipelines to deploy:
Topics, connectors, ksqlDB queries
Kafka Streams applications
Support monitoring and troubleshooting using Control Center / logs / metrics.

📌 Kafka Developer Hyderabad
🏢 Tata Consultancy Services
📍 Hyderabad