12 Sep
|
Wysetek Systems Technologists
|
Mumbai
12 Sep
Wysetek Systems Technologists
Mumbai
Job Title: Kafka Administrator / Confluent Kafka Engineer
Job Type: Full time
Experience: 6+ Years
About the Role
We are looking for a skilled and proactive Confluent Kafka Administrator / Engineer with over 6+ years of experience managing and supporting distributed streaming platforms. The ideal candidate will have hands-on experience in administering Kafka clusters, implementing security and automation practices, and ensuring seamless data integration across cloud-native environments.
You will be responsible for maintaining high availability and performance of our Kafka infrastructure, managing Kafka Connectors, integrating with AWS and DevOps tools, and providing production support.
Key Responsibilities
- Design, deploy, and administer multi-node Confluent Kafka clusters ensuring high
availability and fault tolerance.
- Manage Kafka Connect (Source & Sink) for efficient data streaming across systems.
- Implement and maintain Kafka security features including SSL/TLS, SASL, and
ACL configurations.
- Automate Kafka cluster operations and topic/user provisioning using Ansible and
CI/CD pipelines (Jenkins, GitLab).
- Monitor and optimize Kafka performance using Prometheus, Grafana, Splunk, and
Confluent Control Center (C3).
- Plan and execute cluster upgrades, patch management, and zero-downtime
migrations.
- Provide 24/7 production support, troubleshoot issues, and collaborate with
Confluent Support to resolve incidents.
- Support the integration of producer/consumer applications and ensure proper
consumer rebalancing.
- Manage schema registry, Kafka log files, and Zookeeper cluster configurations.
- Work closely with DevOps and cloud teams for container orchestration (Docker,
Kubernetes) and cloud provisioning (AWS, Azure, GCP).
- Manage AWS services such as MSK, EC2, IAM, S3, CloudWatch, RDS, EKS, and
Opensearch. Required Skills & Experience:
- 6+ years of hands-on experience in Confluent Kafka administration and support.
- Strong expertise in Kafka Connect, Zookeeper, Schema Registry, Kafka Streams,
and KSQL.
- Proficient with AWS Cloud Services including MSK, EC2, IAM, S3, CloudWatch,
and EKS.
- Working knowledge of Linux-based environments (Amazon Linux, Red Hat).
- Experience with DevOps tools: Jenkins, GitLab, Ansible, Docker, and Kubernetes.
- Solid scripting knowledge in Python, Bash/Shell scripting, and familiarity with
SQL.
- Exposure to CI/CD pipelines and automation of Kafka-related tasks.
- Strong analytical and troubleshooting skills with a focus on performance and
reliability.
- Excellent communication skills and experience working with support teams and
cross-functional stakeholders.
Preferred Qualifications
- Experience working with Confluent Support for enterprise Kafka issues.
- Knowledge of MongoDB, MySQL, Oracle, and data integration practices.
- Familiarity with Azure or GCP cloud platforms.
📌 Kafka Administrator (Mumbai)
🏢 Wysetek Systems Technologists
📍 Mumbai