10 Aug
|
Zorba consulting
|
Bengaluru
10 Aug
Zorba consulting
Bengaluru
- We are seeking a highly skilled Data Streaming Engineer with 8
- 10 years of experience in designing, developing, and optimizing large-scale real-time and batch data processing solutions.
- The ideal candidate should have strong hands-on expertise in Apache Flink and Apache Spark, with experience building high-performance streaming pipelines, event-driven architectures, and enterprise-grade data platforms.
- The candidate must have strong expertise in Apache Flink DataStream API, Table API, and SQL API, including stateful stream processing, event-time processing, windowing, checkpointing, fault tolerance, watermarks, and late-event handling.
- Experience with Flink deployment and operations in distributed environments is required.
- Robust proficiency in Apache Spark Core, Spark SQL, and Structured Streaming is essential,
along with experience developing high-volume ETL and data transformation pipelines and optimizing Spark jobs for performance, scalability, and resource utilization.
- The role involves designing and maintaining scalable real-time data pipelines, developing batch and near-real-time ETL workflows, processing large-scale datasets with low latency and high throughput, and implementing monitoring, logging, troubleshooting, data quality, governance, and security practices.
- Candidates should ideally have experience with Kafka, Azure Event Hubs, or other messaging platforms, distributed systems, microservices, and cloud platforms such as AWS, Azure, or GCP.
- Knowledge of Docker, Kubernetes, CI/CD, and programming languages such as Java, Scala, or Python is preferred.
Location - Delhi NCR,Bangalore,Chennai,Pune,Kolkata,Ahmedabad,Mumbai,Hyderabad
📌 Data Flink Professional (Bengaluru)
🏢 Zorba consulting
📍 Bengaluru