We are seeking a highly skilled AWS Cloud Kafka Platform Engineer with strong expertise in AWS MSK Apache Kafka and Cloudera streaming platforms The ideal candidate will be responsible for designing implementing operating and supporting highly available secure and scalable streaming platforms across nonproduction and production environments This role requires close collaboration with clients to understand business use cases and deliver reliable streaming solutions

Key Roles Responsibilities

Kafka Streaming Platform Operations

Design set up and operate AWS MSK and Apache Kafka clusters integrated with the Cloudera platform and Confluent Cloud

Participate in PI planning resolve dependencies between components and communicate solution intent across teams

Provide operational support for nonprod and PROD Kafka clusters ensuring high availability and performance

Perform cluster upgrades topic management partitioning strategies and capacity planning

Configure and manage Kafka Connectors for data ingestion and streaming use cases

Troubleshoot and resolve Kafkarelated issues including broker failures consumer lag replication issues and performance bottlenecks

Provide operational support monitoring and incident remediation for production systems

Cloud Infrastructure Automation

Strong understanding and implementation of Infrastructure as Code IaC practices

Experience developing automated deployment and configuration management solutions

Provision and manage cloud infrastructure using Terraform

Deploy and manage Kafkarelated components using Helm Charts

Automate operational tasks using Shell scripting

Ensure infrastructure follows best practices around security scalability and cost optimization

Security Governance





Implement and manage Kafka security mechanisms including

TLS SSL encryption

SASL SCRAM IAM etc

ACLbased authorization

Enforce security policies aligned with organizational and compliance requirements

Monitoring Logging Observability

Provide all required technical details and inputs to the Monitoring team for the setup of dashboards

Build maintain and enhance monitoring dashboards using observability tools such as Dynatrace Splunk

Ensure dashboards effectively track system health performance metrics and ing for Kafka and streaming platforms

Proactively monitor system health performance and availability

Set up s and incident response procedures for production environments

Agile Delivery Collaboration

Work in an Agile workplace managing tasks and stories using JIRA

Maintain source code infrastructure code and deployment artifacts in GitLab

Use Confluence Cloud for technical documentation runbooks and knowledge sharing

Collaborate closely with application teams architects and clients to align streaming solutions with business needs

Incident Management

Working knowledge of ServiceNow for incident change and support oncall rotation

Technical Skills

Must have

Kafka Operations

Deep understanding of Apache Kafka architecture brokers topics partitions replicas ISR leader election





Strong experience supporting Kafka in production environments

Kafka Security

Streaming Replication

Cloudera Kafka Streams Messaging

Kafka Connect

Confluent Replicator Cluster Linking

Cloud

AWS with focus on AWS MSK

Terraform

Helm Charts

Shell Scripting

CICD GitOps Version Control

Experience with GitLab for source control and CICD pipelines

Deep understanding of Git concepts

Hands on experience with GitOps tools such as Argo CD for continuous delivery and deployment automation

Tools Platforms

JIRA Agile project management

GitLab version control CICD

Confluence documentation

Good to have knowledge in DR

Disaster Recovery Replication

Design and implement Disaster Recovery DR strategies for streaming platforms

Configure and manage

Cloudera Streams Messaging Replicator

Confluent Replicator

Confluent Cluster Linking

Good to Have

Experience in resolving critical production incidents under tight SLAs

Exposure to largescale multiregion Kafka deployments

Performance tuning and cost optimization for Kafka and cloud infrastructure

Soft Skills

Excellent communication and client engagement skills

Strong problemsolving mindset with the ability to handle highpressure situations

Eagerness and capability to learn new technologies and concepts quickly

Ability to work closely with clients to understand business use cases and translate them into technical solutions

Team management skills

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Apache Kafka Professional (Mumbai)
🏢 Envision Technology Solutions
📍 Mumbai