24 Sep
Zyoin Group
Mumbai
Job Title: Data Engineer (CDC / Realtime Data Integration)
Location: Navi Mumbai, India
Experience Level: 4–6 Years
About the Role:
We are seeking a skilled and experienced Data Engineer with expertise in Change Data Capture (CDC) and real-time data integration. The ideal candidate will have hands-on experience in designing, implementing, and managing real-time data pipelines using Debezium, Kafka, and related technologies.
This role requires building low-latency pipelines that enable instant data availability for analytics, operational reporting, and downstream systems, ensuring data integrity and scalability in a fast-paced environment.
Key Responsibilities:
- Design, develop,
and maintain real-time data ingestion pipelines using CDC from relational and NoSQL databases.
- Implement and manage data streaming solutions using Apache Kafka, Kafka Connect, and Debezium.
- Configure and monitor Debezium connectors for accurate data capture.
- Develop real-time data transformation logic using Spark Streaming, Flink, or Kafka Streams.
- Ensure data quality, consistency, and governance across real-time pipelines.
- Collaborate with application teams, analysts, and data scientists to meet real-time data needs.
- Troubleshoot and resolve pipeline, Kafka cluster, and connector issues.
- Implement monitoring, logging, and alerting to ensure availability and performance.
- Document real-time architectures, flows, and procedures.
- Adhere to data governance and compliance standards.
Technical Skills:
- Real-time Data Integration: Strong experience with CDC mechanisms.
- Streaming Tech: Apache Kafka, Kafka Connect, Kafka Streams.
- CDC Tools: Debezium (hands-on expertise).
- Programming: Python or Java (Spring Boot, REST APIs), Shell scripting.
- Big Data:
Apache Spark Streaming, Apache Flink (preferred).
- Cloud: GCP (BigQuery, Data Lakes) or equivalent platforms.
- Databases: Relational + NoSQL for CDC integration.
- SQL: Advanced querying & validation skills.
- DevOps: Docker, Kubernetes, CI/CD deployment.
- Monitoring: Prometheus, Grafana for real-time data health.
Collaboration & Soft Skills:
- Strong collaboration with cross-functional engineering and business teams.
- Ability to clearly document and present real-time data architectures.
- Skilled in stakeholder communication (technical & non-technical).
- Proactive problem solver with attention to data integrity & reliability.
- Adaptable, self-driven, and detail-oriented.
Qualifications:
- BE/B.Tech and/or M.Tech in a relevant discipline.
- 4–6 years of Data Engineering experience with a focus on CDC & real-time data integration.
- Exposure to BFSI/NBFC domain is a strong advantage.
📌 Urgent Search! Data Engineer
🏢 Zyoin Group
📍 Mumbai
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.