16 Aug
|
Technology next
|
India
16 Aug
Technology next
India
Kafka Architect
Job Title: Kafka Architect
Experience: 6–8 Years
Employment Mode: C2H
Work Mode: Onsite / Hybrid
Location: Chennai | Hyderabad | Bangalore
Job Summary
We are seeking an experienced Kafka Architect with 6–8 years of expertise in designing, implementing, and managing highly available, scalable, secure, and reliable Apache Kafka platforms.
The ideal candidate should have strong hands-on experience with Kafka architecture, Kafka Connect, Kafka Streams, Schema Registry, DevOps, CI/CD, Kubernetes, cloud platforms, and event-driven architectures.
Key Responsibilities
- Design, implement, and maintain highly available, scalable, and secure Apache Kafka platforms.
- Define Kafka architecture covering clusters, topics, partitions, replication, capacity planning, and disaster recovery.
- Design and implement Kafka-based integrations with applications, databases, and streaming platforms using producers, consumers, and Kafka Connect.
- Optimize Kafka cluster performance, throughput, capacity, and reliability.
- Implement Kafka security using SSL/TLS, SASL, ACLs, authentication, authorization, and encryption.
- Monitor Kafka clusters and proactively troubleshoot performance and production issues.
- Ensure Kafka platform high availability, fault tolerance, and disaster recovery.
- Automate Kafka deployment, configuration, and operational activities using DevOps tools and Infrastructure as Code.
- Work with Jenkins, GitLab CI/CD, Docker, Kubernetes, Ansible, and Terraform for automation and deployment.
- Establish Kafka governance, architecture standards, best practices,
and operational procedures.
- Collaborate with development, infrastructure, DevOps, and application teams to implement event-driven solutions.
- Provide technical leadership and guidance for Kafka implementations.
- Create and maintain technical architecture documents, operational procedures, and implementation guidelines.
- Mentor development and engineering teams on Kafka best practices and enterprise messaging patterns.
Required Skills & Qualifications
- 6–8 years of overall IT experience with strong hands-on experience in Apache Kafka.
- Strong expertise in Apache Kafka architecture and administration.
- Hands-on experience with:
- Kafka Connect
- Kafka Streams
- Schema Registry
- ZooKeeper / KRaft
- Kafka Producers & Consumers
- Strong understanding of Kafka clusters, topics, partitions, replication, retention, and capacity planning.
- Experience with Linux and Java.
- Experience with GitLab CI/CD and DevOps automation.
- Hands-on experience with Kubernetes / OpenShift.
- Knowledge of cloud platforms such as AWS, Azure, or GCP.
- Experience implementing Kafka security using SSL/TLS, SASL, ACLs, and encryption.
- Strong understanding of high-availability and disaster-recovery architectures.
- Experience with monitoring and observability tools such as Prometheus and Grafana.
- Robust knowledge of networking, performance tuning, and production troubleshooting.
- Experience with event-driven architecture and enterprise messaging solutions.
DevOps & Automation Skills
The candidate should have experience with one or more of the following:
- GitLab CI/CD
- Jenkins
- Docker
- Kubernetes / OpenShift
- Ansible
- Terraform
- Infrastructure as Code
- Automated Kafka deployment and configuration
Preferred Skills
- Experience designing Kafka platforms for large-scale enterprise environments.
- Experience with multi-cluster and multi-region Kafka architectures.
- Experience with Kafka disaster recovery and business continuity solutions.
- Experience with cloud-native Kafka deployments.
- Knowledge of Confluent Kafka ecosystem.
- Experience working with application, infrastructure, and DevOps teams in Agile environments.
Ideal Candidate
The ideal candidate will be a hands-on Kafka Architect capable of designing enterprise-grade Kafka platforms, implementing secure and highly available architectures, optimizing Kafka performance, and automating platform operations through DevOps and CI/CD practices.
Strong experience in Kafka + GitLab CI/CD + DevOps + Kubernetes + Cloud + Event-Driven Architecture is highly preferred.
Pay: ₹90,000.00 - ₹130,000.00 per month
Experience:
- over all IT: 6 years (Required)
Work Location: Hybrid remote in Hyderabad, Telangana (Hyderabad District)
📌 Kafka Architect (India)
🏢 Technology next
📍 India