We are seeking a highly skilled Data Engineer with robust hands-on expertise in Apache Flink and Apache Spark to design, develop, and optimize large-scale real-time and batch data processing solutions. The ideal candidate will have experience building high-performance streaming pipelines, event-driven architectures, and enterprise-grade data platforms.
Required Technical Skills
Strong hands-on experience with Apache Flink DataStream API.
Expertise in Flink Table API and SQL API.
Experience designing and implementing:
Stateful stream processing
Event-time processing
Windowing operations
Checkpointing and fault tolerance
Watermarks and late-event handling
Experience with Flink deployment and operations in distributed environments.
Strong proficiency in Apache Spark, including:
Spark Core
Spark SQL
Spark Structured Streaming
Experience developing high-volume ETL and data transformation pipelines.
Strong understanding of Spark execution architecture, resource management, performance tuning, and optimization.
Strong understanding of Data Architecture and Modeling.
Responsibilities
Design, develop, and maintain scalable real-time data processing pipelines.
Build streaming applications using Apache Flink and Spark Structured Streaming.
Develop batch and near-real-time ETL workflows.
Process and analyze large-scale datasets with low latency and high throughput.
Optimize data pipelines for performance, reliability, scalability, and fault tolerance.
Implement monitoring, logging, alerting, and troubleshooting for data processing applications.
Ensure data quality, governance, security, and compliance standards are followed.
Collaborate with Data Engineers, Data Architects, and Business Stakeholders to deliver enterprise data solutions.
Contribute to Agile development practices and continuous improvement of data engineering processes.
📌 Data Engineer (India)
🏢 Technorover
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.