Minimum Required Experience : 4 years

Contract

Skills

Kafka Connect

Apache Flink

Confluent Kafka

Ansible

Infrastructure As Code

Description

Senior Cloud Data Engineer

KEY ACCOUNTABILITIES:

- Administer, monitor, and support Confluent Kafka Platform environments, ensuring high availability, performance, scalability, and security.
- Install, configure, upgrade, patch, and maintain Kafka brokers, ZooKeeper/KRaft, Schema Registry, Kafka Connect, Control Center, Flink and REST Proxy.
- Deploy, manage, and troubleshoot Kafka Connect source and sink connectors including CDC, JDBC, S3/ADLS, IBM MQ, and REST connectors.
- Manage platform infrastructure on PAAS/IaaS environments (Azure, AWS, or On-Premises Linux servers), including capacity planning and performance tuning.
- Automate Kafka platform provisioning, deployment, and operational activities using Ansible and Infrastructure as Code practices.
- Monitor platform health, consumer lag, broker performance, connector status, and proactively resolve incidents and production issues.
- Implement security controls including SSL/TLS, RBAC, LDAP/AD integration, Secrets Management, and encryption standards.
- Perform disaster recovery testing, backup validation, platform upgrades, and infrastructure maintenance activities.
- Raise and manage ServiceNow incidents, service requests, change requests, and support audit/compliance requirements.




- Collaborate with application, infrastructure, cloud, and data engineering teams to onboard and support enterprise streaming use cases.

. FRAMEWORKS, BOUNDARIES, & DECISION MAKING AUTHORITY:

- Functions within the framework and boundaries of Group policies as well as overall organisational and governance frameworks.
- Authorised to take decisions as per the approved authorisation matrix.

Minimum Qualification

- 4-6 years of experience in Confluent Platform administration and support.
- Strong experience with Confluent Platform components including Kafka Brokers, Schema Registry, Kafka Connect, Control Center, and ksqlDB/Flink.
- Hands-on experience with Flink for stream processing and real-time data pipelines.
- Experience managing Linux-based infrastructure in Azure, AWS, or other IaaS platforms.
- Solid automation and scripting experience using Ansible, Shell Scripting, or Python.
- Experience with SSL, RBAC, LDAP, authentication, authorization, and Kafka security best practices.
- Knowledge of monitoring tools such as Prometheus, Grafana, Splunk, or ELK.
- Experience with CI/CD pipelines and infrastructure automation.
- Strong troubleshooting, problem-solving, and stakeholder communication skills.

Experience in implement application self-healing solutions through proactive and reactive automated measures

📌 Senior Software Engineer-Performance Test Engineer (Bengaluru)
🏢 NeST Digital
📍 Bengaluru