Lead Data Engineer
Experience: 6–8 Years
Location: Bengaluru / Hybrid
Employment Type: Full-Time
Role Overview
We are looking for an experienced Lead Data Engineer with solid hands-on expertise in real-time data streaming, event processing, CDC, data integration, and modern data engineering .
The candidate will be responsible for designing, developing, and maintaining high-performance, production-grade data pipelines using Apache Flink, Apache Kafka, Debezium, CDC, ClickHouse, and Apache Airflow .
This is a hands-on engineering role requiring practical experience in building high-volume, low-latency streaming applications, developing scalable data pipelines, troubleshooting distributed systems, and optimizing data processing workloads.
The ideal candidate should be comfortable working across the complete data pipeline—from source systems and CDC ingestion through Kafka and Flink processing to analytical storage, APIs, dashboards, and downstream integrations .
Key Responsibilities
1. Real-Time Data Engineering
Design, develop,



and maintain real-time data pipelines using Apache Flink and Apache Kafka .
Develop production-grade streaming applications for high-volume and low-latency workloads.
Implement data transformation, filtering, enrichment, aggregation, and event processing.
Build reliable event-processing pipelines with appropriate error handling and recovery mechanisms.
Consume and publish events across Kafka topics.
Implement partitioning, consumer groups, offsets, and appropriate delivery mechanisms.
Troubleshoot streaming pipeline failures, latency, throughput, and performance issues.
2. Apache Flink
Develop and maintain production-grade Apache Flink jobs .
Implement stream transformations, filtering, mapping, aggregations, joins, and windows.
Work with event-time processing, watermarks, and state management .
Implement Flink checkpointing, savepoints, and recovery mechanisms.
Optimize Flink jobs for performance, scalability, and resource utilization.
Monito

📌 Lead Data Engineer (Dharwad)
🏢 Sourcebae
📍 Dharwad