Job Title: Sr. Streaming Solution Engineer

Location: Bengaluru

Experience Level: 6-8years

Employment Type: Full-time

Skill Combination:

Skillset

Description

Java + Kafka

Strong experience in Kafka Streams, event-driven microservices development, custom connector development, advanced streaming application design, connector configuration, and KSQLDB/Flink query development.

OR

DevOps + Kafka

Strong experience in Kafka platform deployment and operations, cluster architecture design, infrastructure automation (Terraform / Ansible), CI/CD pipeline implementation, monitoring, and performance optimization of streaming platforms.

General Summary

The Sr. Streaming Solution Engineer is responsible for designing, implementing and optimizing enterprise-scale real-time data streaming solutions using Apache Kafka and the Confluent Platform. The role focuses on building scalable event-driven architectures, developing advanced streaming applications and ensuring reliable operation of distributed streaming platforms.

The ideal candidate will possess strong expertise in Kafka ecosystem technologies, distributed systems, and real-time data processing architectures, combined with either advanced Java-based application development or DevOps platform engineering capabilities.

This position requires the ability to design robust streaming architectures, optimize data pipelines and collaborate closely with architects, developers and operations teams to deliver scalable and reliable streaming solutions for enterprise environments.

Key Responsibilities

· Design and implement enterprise-scale real-time streaming architectures using Apache Kafka and the Confluent Platform.

· Lead the development of Kafka-based streaming applications, event-driven microservices and integration pipelines.

· Design and implement high-throughput, fault-tolerant streaming data pipelines across enterprise systems.

· Develop and optimize Kafka producers, consumers and streaming services to ensure reliable and efficient data flow.

· Define topic design, partition strategies, replication policies, and consumer group scaling models.

· Design and implement Kafka Connect integrations including development of custom connectors when required.

· Leverage KSQLDB or Apache Flink for real-time data transformations, filtering, and aggregations.





· Provide guidance to engineering teams on best practices for event-driven architectures and streaming application design.

· Lead performance tuning, troubleshooting and optimization of Kafka clusters and streaming workloads.

· Collaborate with DevOps teams to implement CI/CD pipelines, infrastructure automation and containerized deployments.

· Ensure monitoring, observability, and reliability of Kafka infrastructure using enterprise monitoring tools.

· Work closely with architects, developers, platform teams and client stakeholders to deliver scalable streaming solutions.

· Document streaming architectures, integration patterns and operational processes for long-term maintainability.

· Stay updated with emerging technologies and industry best practices in data streaming, distributed systems, and real-time analytics platforms.

Required Skills & Qualifications

· 6-8years of relevant experience in software development, data streaming platforms or distributed systems engineering.

· Strong hands-on experience with Apache Kafka or Confluent Platform in enterprise environments.

· Experience designing and implementing event-driven architectures and real-time data streaming pipelines.

· Solid understanding of distributed system concepts such as scalability, fault tolerance and high availability.

· Experience building and supporting enterprise integration solutions and data streaming platforms.

· Strong analytical and troubleshooting skills for diagnosing complex distributed system issues.

· Experience working in Linux environments and containerized infrastructures.

· Ability to collaborate effectively with architecture, development, and platform teams.

Experience designing and implementing event-driven architectures and microservices-based integrations.

For Java + Kafka role:

· Strong programming experience in Java

· Design and development of Kafka-based streaming microservices and integration services.





· Experience implementing Kafka Streams or real-time stream processing applications.

For DevOps + Kafka role:

· Experience deploying and managing Kafka clusters

· Hands-on experience with container technologies such as Docker and Kubernetes

· Experience implementing CI/CD pipelines using Jenkins, GitLab CI or similar tools

· Familiarity with infrastructure automation tools such as Terraform or Ansible

· Monitoring and observability using Prometheus, Grafana, ELK or similar tools

· Experience in Kafka performance tuning, scaling strategies, and cluster health monitoring.

Leadership & Soft Skills

· Strong communication skills with the ability to explain complex technical concepts to both technical and non-technical stakeholders.

· Ability to lead technical discussions and provide guidance on streaming architecture and best practices.

· Strong collaboration skills to work effectively with cross-functional teams across development, platform engineering and operations.

· Strong ownership mindset with the ability to manage technical tasks independently and mentor junior engineers.

· Ability to work in fast-paced environments and manage multiple priorities effectively.

· Strong documentation and knowledge-sharing practices.

· Commitment to continuous learning and staying updated with emerging technologies in streaming, distributed systems and cloud platforms.

Certifications (Preferred / Add-on)

Professional certifications in data streaming, distributed systems or cloud platforms will be considered an added advantage.

Preferred Certifications:

· Confluent Certified Developer for Apache Kafka (CCDAK)

· Certifications related to Apache Kafka, Confluent Platform or event-driven architectures

· Cloud platform certifications such as AWS, Azure or Google Cloud

· DevOps-related certifications in Kubernetes, Docker or CI/CD technologies.

Candidates possessing the CCDAK certification will have an advantage as it demonstrates validated expertise in developing Kafka-based applications, implementing streaming architectures and working with the Confluent ecosystem.

Pay: ₹2,000,000.00 - ₹3,000,000.00 per year

Benefits

- Health insurance
- Life insurance
- Paid sick time
- Paid time off
- Provident Fund

Work Location: In person

📌 Sr. Streaming Solution Engineer (Bengaluru)
🏢 Giniminds
📍 Bengaluru