25 Aug
|
Innova ESI
|
Noida
Role: Flink Data Engineer
Experience: 10 Year+
Location: Noida / Pune / Bangalore / Gurgaon
.
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and real-time streaming solutions. The ideal candidate will have strong experience with Apache Flink, Databricks, Python, SQL, Java, and modern CI/CD practices. You will collaborate with cross-functional teams to develop high-performance data processing solutions that support analytics, reporting, and machine learning initiatives.
Key Responsibilities
- Design, develop, and optimize batch and real-time data processing pipelines using Apache Flink.
- Build and maintain scalable ETL/ELT workflows on Databricks.
- Develop robust data ingestion frameworks from multiple data sources.
- Write efficient Python, Java, and SQL code for data transformation and processing.
- Design and optimize database schemas, queries, and stored procedures.
- Implement data quality checks, validation, and monitoring processes.
- Develop reusable components and frameworks for data engineering.
- Integrate streaming platforms such as Kafka with Apache Flink.
- Deploy applications using CI/CD pipelines and automate build, testing, and deployment processes.
- Work with cloud-based data platforms and distributed computing environments.
- Monitor, troubleshoot, and optimize production data pipelines.
- Collaborate with Data Scientists, Business Analysts, and Software Engineers to deliver business solutions.
- Follow best practices for security, scalability, performance, and code quality.
- Maintain technical documentation and participate in code reviews.
Required Skills
- Robust experience with Apache Flink for stream processing.
- Hands-on experience with Databricks and Apache Spark.
- Proficiency in Python programming.
- Strong Java development experience.
- Advanced SQL skills, including query optimization and performance tuning.
- Experience with ETL/ELT development.
- Knowledge of Kafka or other messaging platforms.
- Experience with Delta Lake and Lakehouse architecture.
- Hands-on experience with Git and version control systems.
- Experience implementing CI/CD pipelines using tools such as Jenkins, GitHub Actions, GitLab CI, or Azure DevOps.
- Knowledge of Docker and Kubernetes is preferred.
- Experience working with cloud platforms such as Azure, AWS, or Google Cloud Platform.
- Understanding of data governance, security, and data quality principles.
📌 Senior Flink Data Engineer || Noida /Bangalore / Pune || Only Immediate Joiner
🏢 Innova ESI
📍 Noida