Description

- Design, develop, and maintain Kafka-based data integration pipelines using Confluent Platform / Confluent Cloud
- Migrate existing custom connectors to Confluent Managed Connectors (S3 Sink/Source, JDBC, Debezium, REST, etc.)
- Configure, deploy, and monitor Kafka Connect clusters and connector instances
- Implement Schema Registry governance (Avro, JSON Schema, Protobuf) for data contracts
- Build and optimise Kafka Streams or ksqlDB applications for real-time data transformation
- Collaborate with the EIDH architecture team on integration patterns (event-driven, CDC, batch offload)
- Troubleshoot connector failures, consumer lag, partition rebalancing, and throughput issues
- Implement observability: monitoring, alerting, and dashboarding for Kafka ecosystem components
- Support data governance, lineage, and security (ACLs, RBAC, encryption in transit/at rest)
- Participate in incident response and production support for streaming infrastructure

Responsibilities

Key Responsibilities

- Design, develop, and maintain Kafka-based data integration pipelines using Confluent Platform / Confluent Cloud
- Migrate existing custom connectors to Confluent Managed Connectors (S3 Sink/Source, JDBC, Debezium, REST, etc.)
- Configure, deploy, and monitor Kafka Connect clusters and connector instances
- Implement Schema Registry governance (Avro, JSON Schema, Protobuf) for data contracts
- Build and optimise Kafka Streams or ksqlDB applications for real-time data transformation
- Collaborate with the EIDH architecture team on integration patterns (event-driven, CDC, batch offload)




- Troubleshoot connector failures, consumer lag, partition rebalancing, and throughput issues
- Implement observability: monitoring, alerting, and dashboarding for Kafka ecosystem components
- Support data governance, lineage, and security (ACLs, RBAC, encryption in transit/at rest)
- Participate in incident response and production support for streaming infrastructure

Qualifications

Required Skills & Experience

Must Have

- 3+ years hands-on experience with Apache Kafka / Confluent Platform / Confluent Cloud

- Robust experience with Kafka Connect — deploying, configuring, and managing connectors (both self-managed and Confluent Managed)

- Experience migrating from custom/self-managed connectors to Confluent Managed Connectors

- Proficiency with Schema Registry and schema evolution strategies

- Experience with at least 3 of the following connectors: S3 Sink/Source, JDBC Source/Sink, Debezium CDC, HTTP/REST Source/Sink, Oracle CDC

- Solid understanding of Kafka internals: partitioning, replication, consumer groups, offset management

- Experience with Infrastructure as Code (Terraform, Ansible) for Kafka/Confluent resource provisioning





- Proficiency in at least one of: Java, Python, or Go for custom connector development or Kafka Streams

- Experience with CI/CD pipelines for connector deployment and configuration management

- Strong troubleshooting skills for distributed systems

Nice to Have

- Confluent Certified Developer or Administrator certification

- Experience with ksqlDB for stream processing

- AWS ecosystem experience (S3, MSK, Lambda, EventBridge)

- Experience with Oracle integration (ORBC, OCI, ORDS)

- Familiarity with data mesh or event-driven architecture patterns

- Experience with Confluent Cloud Cluster Linking or Schema Linking

- Knowledge of RBAC/ACL configuration in Confluent Platform

- Experience with retail or supply chain domain data

Technical Environment

- Confluent Cloud / Confluent Platform

- Apache Kafka, Kafka Connect, Schema Registry, ksqlDB

- AWS (S3, EC2, IAM, CloudWatch)

- Terraform / Infrastructure as Code

- Git, CI/CD (Jenkins, GitHub Actions, or similar)

- Monitoring: Confluent Control Center, Prometheus, Grafana, Datadog

- Oracle ORBC, REST APIs, ORDS (integration source systems)

Qualifications

- Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience)

- Minimum 5 years overall experience in data engineering or integration roles

- Minimum 3 years focused Confluent/Kafka experience

- Strong communication skills — ability to work with architecture teams and business stakeholders

📌 Confluent Integration Engineer (Pune)
🏢 Zensar Technologies
📍 Pune