Role Description
We are seeking a Senior DevOps Engineer with strong expertise in Apache Kafka and Apache NiFi to design, deploy, optimize, and support enterprise-scale data streaming and ingestion platforms. The role involves managing highly available data infrastructure, implementing automation and CI/CD practices, supporting cloud-native deployments, and ensuring platform reliability, scalability, security, and performance across AWS or Azure environments.
Key Responsibilities
Design, deploy, administer, and optimize Apache Kafka clusters for high-throughput and low-latency data streaming workloads.
Build, manage, and enhance Apache NiFi data flows to support scalable and reliable data ingestion and processing.
Monitor, troubleshoot, and resolve production issues related to Kafka brokers, consumer lag, replication, cluster performance, and NiFi data flows.
Implement and support CI/CD pipelines for application and infrastructure deployments.
Deploy and operate data platform components in AWS or Azure cloud environments.
Automate operational processes, platform provisioning, deployment,
and maintenance activities.
Ensure high availability, disaster recovery readiness, security, and operational excellence across data platforms.
Collaborate with engineering and platform teams to improve scalability, reliability, and performance.
Perform capacity planning, platform upgrades, monitoring, and incident resolution.
Mentor team members and promote best practices for enterprise data platform operations.
Required Skills
Proficient
Kafka
Nifi
Apigee
Redis
AWS or Azure
CICD
Experience
5 to 6 years of overall DevOps or Platform Engineering experience.
Minimum 3 years of hands-on production experience with Apache Kafka.
Minimum 3 years of hands-on production experience with Apache NiFi.
Why Join UST
Work on large-scale digital transformation and data platform initiatives.
Collaborate with global technology teams delivering creative enterprise solutions.
Gain exposure
📌 Senior DevOps Engineer (Pune)
🏢 UST
📍 Pune