General Summary:

The Sr.

Streaming Solution

Engineer is responsible for designing, implementing and optimizing enterprise-scale real-time data streaming solutions using Apache Kafka and the Confluent Platform. The role focuses on building scalable event-driven architectures, developing advanced streaming applications and ensuring reliable operation of distributed streaming platforms.

Skill Combination:

- Java Kafka: Strong experience in Kafka Streams, event-driven microservices development, custom connector development, advanced streaming application design, connector configuration, and KSQLDB/Flink query development.
- OR DevOps Kafka: Strong experience in Kafka platform deployment and operations, cluster architecture design, infrastructure automation (Terraform / Ansible), CI/CD pipeline implementation, monitoring, and performance optimization of streaming platforms.

Key Responsibilities:

- Design and implement enterprise-scale real-time streaming architectures using Apache Kafka and the Confluent Platform.
- Lead the development of Kafka-based streaming applications, event-driven microservices and integration pipelines.
- Design and implement high-throughput, fault-tolerant streaming data pipelines across enterprise systems.
- Develop and optimize Kafka producers, consumers and streaming services to ensure reliable and efficient data flow.
- Define topic design,



partition strategies, replication policies, and consumer group scaling models.
- Design and implement Kafka Connect integrations including development of custom connectors when required.
- Leverage KSQLDB or Apache Flink for real-time data transformations, filtering, and aggregations.
- Lead performance tuning, troubleshooting and optimization of Kafka clusters and streaming workloads.
- Collaborate with DevOps teams to implement CI/CD pipelines, infrastructure automation and containerized deployments.

Required Skills & Qualifications:

- 6 - 8 years of relevant experience in software development, data streaming platforms or distributed systems engineering.
- Strong hands-on experience with Apache Kafka or Confluent Platform in enterprise environments.
- Experience designing and implementing event-driven architectures and real-time data streaming pipelines.
- Solid analytical and troubleshooting skills for diagnosing complex distributed system issues.
- Experience working in Linux environments and containerized infrastructures.

Preferred Certifications:

- Confluent Certified Developer for Apache Kafka (CCDAK)
- Cloud platform certifications such as AWS, Azure or Google Cloud
- DevOps-related certifications in Kubernetes, Docker or CI/CD technologies.

📌 Giniminds - Senior Streaming Solution Engineer - Kafka (India)
🏢 Giniminds
📍 India