09 Sep
|
Zorba Consulting India
|
Hyderabad
09 Sep
Zorba Consulting India
Hyderabad
We are looking for an experienced Kafka CDC Engineer with robust hands-on expertise in Apache Kafka, Kafka Connect, Debezium CDC, and Oracle. The candidate will be responsible for implementing and supporting real-time Change Data Capture (CDC) pipelines, enabling data movement from Oracle databases to Kafka and downstream platforms such as Databricks/Data Lakes.
The ideal candidate should have strong understanding of Kafka topics, source/destination connectivity, event/data handling, schema evolution, and production support.
Key Responsibilities
- Implement and configure Debezium CDC for capturing changes from Oracle 19c/21c logs and APIs.
- Configure Kafka Connect and Debezium connectors for Oracle-to-Kafka data pipelines.
- Design and configure Apache Kafka topics to capture and distribute database change events.
- Manage CDC event flow from Oracle tables → Debezium → Kafka topics → downstream systems.
- Configure and troubleshoot source and destination connections for Kafka-based data pipelines.
- Integrate Kafka CDC pipelines with Databricks, Data Lake,
and other downstream data platforms.
- Handle schema evolution, data validation, data consistency, and transformation requirements.
- Monitor Kafka topics, connectors, consumer/producer activity, and CDC pipelines in production.
- Troubleshoot production incidents related to Kafka, Debezium, Kafka Connect, Oracle connectivity, offsets, lag, and data discrepancies.
- Perform root-cause analysis and implement permanent fixes for production issues.
- Optimize Kafka and CDC pipeline performance, throughput, and reliability.
- Develop and maintain SQL/PLSQL and Shell scripts for data validation, automation, and operational activities.
- Work with Linux environments for deployment, monitoring, troubleshooting, and automation.
- Collaborate with application, database, cloud, and data engineering teams to ensure reliable end-to-end data flow.
Mandatory Skills
- 5–8 years of relevant experience in Data Engineering / St
📌 Kafka CDC Engineer (Hyderabad)
🏢 Zorba Consulting India
📍 Hyderabad