Lead Data Engineer
Experience:

6–8 Years
Location:

Bengaluru / Hybrid
Employment Type:

Full time
Role Overview
We are looking for an experienced

Lead Data Engineer

with strong hands-on expertise in

real-time data streaming, event processing, CDC, data integration, and modern data engineering .
The candidate will be responsible for designing, developing, and maintaining high-performance, production-grade data pipelines using

Apache Flink, Apache Kafka, Debezium, CDC, ClickHouse, and Apache Airflow .
This is a

hands-on engineering role

requiring practical experience in building high-volume, low-latency streaming applications, developing scalable data pipelines, troubleshooting distributed systems, and optimizing data processing workloads.
The ideal candidate should be comfortable working across the complete data pipeline—from

source systems and CDC ingestion through Kafka and Flink processing to analytical storage, APIs, dashboards, and downstream integrations .
Key Responsibilities
1. Real-Time Data Engineering
Design, develop,



and maintain real-time data pipelines using

Apache Flink and Apache Kafka .
Develop production-grade streaming applications for high-volume and low-latency workloads.
Implement data transformation, filtering, enrichment, aggregation, and event processing.
Build reliable event-processing pipelines with appropriate error handling and recovery mechanisms.
Consume and publish events across Kafka topics.
Implement partitioning, consumer groups, offsets, and appropriate delivery mechanisms.
Troubleshoot streaming pipeline failures, latency, throughput, and performance issues.
2. Apache Flink
Develop and maintain production-grade

Apache Flink jobs .
Implement stream transformations, filtering, mapping, aggregations, joins, and windows.
Work with

event-time processing, watermarks, and state management .
Implement Flink checkpointing, savepoints, and recovery mechanisms.
Optimize Flink jobs for performance, scalability, and resource utiliz

📌 Lead Data Engineer (Bengaluru)
🏢 Sourcebae
📍 Bengaluru