29 Sep
|
Mitr HR Private
|
Hyderabad
29 Sep
Mitr HR Private
Hyderabad
Job Description – Java with Kafka / AWS Kafka EngineerPosition: Java with Kafka / AWS Kafka EngineerExperience: 5+ YearsEmployment Type: Full-TimeWork Mode: [Work From Office / Hybrid / Remote]
Position Overview
We are looking for an experienced Java with Kafka / AWS Kafka Engineer with strong expertise in Apache Kafka administration, architecture, development, and AWS cloud environments. The ideal candidate will be responsible for designing, implementing, managing, monitoring, and optimizing highly available Kafka platforms and event-driven applications.
The candidate should have robust hands-on experience with Java, Apache Kafka, AWS MSK, Kafka migration, replication, Kubernetes, Linux administration, and automation. Experience in migrating Kafka workloads to AWS and managing large-scale distributed systems will be highly preferred.
Key Responsibilities
- Design, deploy, configure, and administer Apache Kafka clusters in production environments.
- Develop and maintain Kafka-based applications and integrations using Java.
- Manage AWS MSK (Managed Streaming for Apache Kafka) environments, including configuration, monitoring, scaling, and troubleshooting.
- Plan and execute Kafka-to-AWS migration activities with minimal business disruption.
- Implement and manage MirrorMaker 2 and other Kafka replication technologies for data replication and disaster recovery.
- Configure and optimize Kafka brokers, topics, partitions, replication factors, retention policies, and consumer groups.
- Troubleshoot Kafka performance, connectivity, latency, throughput, and availability issues.
- Work with Linux/Unix systems for administration, troubleshooting, automation, and performance monitoring.
- Develop automation scripts using Python, Java, or Shell scripting.
- Deploy and manage Kafka-related workloads using Kubernetes, including AWS EKS and ECS environments.
- Integrate Kafka services with AWS CloudWatch and other monitoring and logging platforms.
- Collaborate with DevOps teams to implement and maintain CI/CD pipelines using tools such as GitLab and Jenkins.
- Implement secure Kafka environments using VPC, IAM, TLS, authentication, authorization, and other security mechanisms.
- Participate in architecture discussions and recommend solutions for scalability, reliability, high availability, and disaster recovery.
- Support production incidents, root-cause analysis, capacity planning, and continuous platform improvement.
Required Skills & Experience
- 5+ years of experience in Java and distributed/event-driven systems.
- Strong hands-on experience with Apache Kafka administration and architecture.
- Experience with AWS MSK and AWS cloud services.
- Proven experience in Kafka-to-AWS migration projects.
- Strong knowledge of MirrorMaker 2 or Kafka replication tools.
- Proficiency in Java, with working knowledge of Python and/or Shell scripting.
- Strong Linux/Unix administration and troubleshooting skills.
- Experience with AWS EKS, ECS, and CloudWatch.
- Good understanding of Kubernetes and CI/CD practices.
- Strong understanding of Kafka architecture, brokers, producers, consumers, partitions, replication, offsets, and consumer groups.
Good-to-Have Skills
- Experience with Kafka Connect, Kafka Streams, and Schema Registry.
- Knowledge of Prometheus, Grafana, and Splunk.
- Understanding of VPC, IAM, TLS, and cloud security concepts.
- Experience developing or integrating REST APIs.
- Hands-on experience with GitLab and Jenkins.
- Experience with AI-assisted automation and using AI tools to improve operational efficiency.
Key Competencies
- Strong analytical and problem-solving skills.
- Ability to troubleshoot complex production issues independently.
- Good communication and collaboration skills.
- Strong understanding of high availability, scalability, security, and disaster recovery.
- Ability to work in a fast-paced environment and manage multiple technical priorities.
Education
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
📌 Java with Kafka(29) (Hyderabad)
🏢 Mitr HR Private
📍 Hyderabad