Job Summary The team member will be part of a Kafka platform development team responsible for architecture administration and operations for Kafka clusters across all nonproduction and production environments The role involves best design solution ensuring system reliability optimizing performance automating regular tasks providing guidance to team for onboarding applications helping team for upskillcrosstraining and troubleshooting issues to maintain seamless Kafka operations
Key Responsibilities
Architect Manage and maintain Kafka clusters in nonprod and prod environments
Responsible for high level discussions with customers
Responsible for proposing best solutions as per industry standards
Responsible for doing POCs and documenting the exercise
Getting involved with team members to solve their technical problems
Handling high priority discussions and drive the meetings with vendor if required
Skills and Abilities
Strong knowledge of Kafka architecture
Handson experience with Kafka cluster setup using ZookeeperKraft
Proficiency in working with Kafka connectors and ksqlDB
Experience with Kubernetes for Kafka deployment and management
Ability to create Docker images and work with containerized environments
Proficiency in writing YAML configurations
Solid troubleshooting and debugging skills
Experience with monitoring tools like Datadog
Experience in creating monitorss from inbuilt JMX metrics for Kafka server consumer metrics producer metrics etc
Familiarity with GitLab CICD pipelines
Proficiency in Terraform for infrastructure automation
Strong understanding of AWS cloud services
Helping team members to troubleshooting best practices etc
Experience with IT service management processes incident change and problem management
Experience
10 years of experience managing Kafka clusters in production environments
Experience setting up and maintaining Kafka on Kubernetes
Handson experience with AWS cloud infrastructure
Experience with CICD pipelines infrastructure automation and monitoring tools
Certifications confluent AWS
Experience in user onboarding through selfservice
Familiarity with CFK operator or any other operator for Apache Kafkaconfluent Kafka on EKS
Good and proactive in terms of offering solutions to customers