10 Aug
|
Weekday AI
|
Pune
This role is for one of the Weekday's clients
Salary range: Rs 600000 - Rs 1000000 (ie INR 6 - 10 LPA)
Min Experience: 3+ years
Location: Pune
JobType: full-time
We are looking for a skilled Confluent Integration Engineer with 3–6 years of experience in designing, developing, implementing, and supporting real-time data integration solutions using Apache Kafka and Confluent Platform. The ideal candidate will have strong hands-on expertise in Kafka-based architectures, Confluent connectors, data pipelines, and event-driven integration patterns.
You will work closely with engineering, application, data, and infrastructure teams to build reliable, scalable, and high-performance streaming solutions. The role requires solid troubleshooting skills and the ability to manage Kafka and Confluent integrations across development, testing, and production environments.
Key Responsibilities
Design, develop, configure, and maintain real-time data integration pipelines using Apache Kafka and Confluent Platform.
Implement and manage Kafka Connect frameworks and Confluent connectors for integrating databases, applications, APIs, cloud platforms, and enterprise systems.
Configure and maintain Source and Sink Connectors, including connector properties, transforms, converters, tasks, and worker configurations.
Develop scalable event-driven integration solutions using Kafka topics, partitions, consumer groups, producers, and consumers.
Monitor Kafka clusters, Connect workers, connectors, and data pipelines to ensure availability, reliability, and performance.
Troubleshoot connector failures, message delivery issues, consumer lag, serialization problems, schema-related issues, and pipeline disruptions.
Work with Confluent Schema Registry to manage Avro, JSON Schema, or Protobuf schemas and maintain data compatibility.
Optimize Kafka configurations including partitions, replication, retention, consumer settings, and connector task allocation.
Implement data transformation and routing requi
📌 Confluent Integration Engineer (Pune)
🏢 Weekday AI
📍 Pune