31 Jul
|
Innova ESI
|
Noida
Job Title: Flink Data Engineer
Location: Gurgaon/ Noida/Bangalore / Hyderabad (Hybrid Mode)
Experience: 10+ Years Job Summary
We are looking for an experienced Flink Data Engineer with strong hands-on expertise in Apache Flink, Apache Kafka, Python, and Databricks. The ideal candidate will have extensive experience in designing and developing real-time streaming data pipelines, processing large-scale datasets, and building high-performance data engineering solutions. The candidate should be capable of working in a fast-paced environment and collaborating with cross-functional teams to deliver scalable and reliable data platforms.
Required Skills
Must Have Strong hands-on experience with Apache Flink (mandatory) Extensive experience with Apache Kafka Strong programming skills in Python Hands-on experience with Databricks Experience in building real-time streaming data pipelines Strong understanding of distributed data processing frameworks Experience with data integration, ETL/ELT pipelines, and data transformation Knowledge of SQL and data modeling Experience with performance tuning and troubleshooting streaming applications Good to Have Apache Spark Delta Lake Azure/AWS/GCP cloud platforms CI/CD tools Docker and Kubernetes Airflow or other workflow orchestration tools Key Responsibilities
Design, develop, and maintain real-time data processing applications using Apache Flink. Build and optimize scalable streaming pipelines using Apache Kafka.
Develop robust ETL/ELT workflows using Python and Databricks. Process high-volume, low-latency streaming data efficiently.
Optimize
Flink jobs for performance, scalability, and fault tolerance. Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver effective solutions. Monitor production pipelines and troubleshoot performance issues. Implement data quality checks, monitoring, and logging. Follow best practices for code quality, testing, and deployment.
Required
Experience
10+ years of experience in Data Engineering. 3+ years of hands-on experience with Apache Flink. Solid experience with Kafka, Python, and Databricks.
Experience in real-time data streaming and event-driven architectures.
Experience working with large-scale distributed data systems. Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Strong analytical, problem-solving, and communication skills. Ability to work independently as well as in a collaborative team environment.
Preferred Candidate
Profile
Proven experience in designing enterprise-grade streaming solutions. Strong understanding of distributed computing concepts.
Experience in Agile/Scrum environments. Ability to mentor junior engineers and contribute to architectural decisions.
Mandatory
Skills
Apache Flink (Hands-on experience is mandatory) Apache Kafka Python Databricks
📌 Data Engineer (Apache Flink, DataBrick, Python) || 10 Year+ || Pan India || Only Immediate Joiner (Noida)
🏢 Innova ESI
📍 Noida