We are seeking a highly skilled Data Engineer with strong hands-on expertise in Apache Flink and Apache Spark to design, develop, and optimize large-scale real-time and batch data processing solutions. The ideal candidate will have experience building high-performance streaming pipelines, event-driven architectures, and enterprise-grade data platforms.

Required Technical Skills

- Strong hands-on experience with Apache Flink DataStream API.
- Expertise in Flink Table API and SQL API.
- Experience designing and implementing:
- Stateful stream processing
- Event-time processing
- Windowing operations
- Checkpointing and fault tolerance
- Watermarks and late-event handling
- Experience with Flink deployment and operations in distributed environments.
- Strong proficiency in Apache Spark, including:
- Spark Core
- Spark SQL
- Spark Structured Streaming
- Experience developing high-volume ETL and data transformation pipelines.
- Robust understanding of Spark execution architecture, resource management, performance tuning, and optimization.




- Strong understanding of Data Architecture and Modeling.

Responsibilities

- Design, develop, and maintain scalable real-time data processing pipelines.
- Build streaming applications using Apache Flink and Spark Structured Streaming.
- Develop batch and near-real-time ETL workflows.
- Process and analyze large-scale datasets with low latency and high throughput.
- Optimize data pipelines for performance, reliability, scalability, and fault tolerance.
- Implement monitoring, logging, alerting, and troubleshooting for data processing applications.
- Ensure data quality, governance, security, and compliance standards are followed.
- Collaborate with Data Engineers, Data Architects, and Business Stakeholders to deliver enterprise data solutions.
- Contribute to Agile development practices and continuous improvement of data engineering processes.

📌 Data Engineer (India)
🏢 Technorover
📍 India