Roles and Responsibilities : Kafka Administration: Deploy, configure, and maintain high-availability Kafka clusters across on-prem and cloud environments (Azure, GCP). Manage topics, partitions, and replication to ensure system reliability.
ITSM Integration: Manage the platform lifecycle using ITSM processes, including Incident, Problem, and Change Management, to minimize downtime and ensure compliance with SLAs. Security & Compliance: Implement and manage security protocols, including TLS encryption, SASL/Kerberos authentication, and RBAC.
Performance Optimization: Monitor cluster health using tools like dynaTrace, Prometheus and Grafana; perform capacity planning and performance tuning to support high-throughput data pipelines.
Collaboration: Act as a bridge between DevOps and Application teams, providing guidance on event-driven architecture and best practices for producer/consumer performance.
OOP-Based Development & Automation: Design and develop robust, reusable framework/code, automation tools and APIs (using Java, or Scala) to streamline cluster provisioning, monitoring, and self-service onboarding. Job Requirements :' Solid understanding of Kafka architecture, including clusters, brokers, and streams.
Experience with DevOps practices such as CI/CD pipelines. Proficiency in Java programming language. Familiarity with Kafka messaging systems and stream processing. Ability to work collaboratively in a team setting. Robust problem-solving skills and attention to detail. 35 years in Kafka administration and 5 years in software development or systems engineering. .