21 Nov
|
Weekday AI
|
Bengaluru
21 Nov
Weekday AI
Bengaluru
This role is for one of Weekday’s clients Salary range: Rs 1500000
- Rs 2500000 (ie INR 15
- 25 LPA) Min
Experience:
4+ years
Location:
Bengaluru JobType: full-time We are seeking a skilled Site Reliability Engineer (SRE) to design, operate, and scale the high-performance infrastructure powering next-generation Generative AI (GenAI) platforms. The role will focus on ensuring the reliability, availability, scalability, and performance of production infrastructure, with particular emphasis on Kubernetes, GPU-enabled environments, and model-serving platforms. The ideal candidate will have strong hands-on experience managing production Kubernetes clusters, troubleshooting complex infrastructure issues, automating operational workflows, and maintaining highly available cloud environments. This is an infrastructure-focused engineering position requiring expertise in SRE practices, DevOps, Linux, networking, observability, and infrastructure automation rather than application development. You will take end-to-end ownership of critical production systems, drive reliability improvements, and build the infrastructure foundation required to support scalable AI workloads. Requirements
Key Responsibilities
1. Infrastructure Reliability & Platform Operations
- Own the availability, reliability, scalability, and performance of production infrastructure and platform services.
- Operate and maintain production Kubernetes clusters, ensuring stability and efficient resource utilization.
- Manage cluster upgrades, networking, ingress configurations, autoscaling, workload scheduling, and resource optimization.
- Monitor infrastructure health and proactively identify potential performance bottlenecks and reliability risks.
- Troubleshoot complex production issues across nodes, networks, containers, and Kubernetes clusters.
- Support high-performance GPU infrastructure and model-serving environments. 2. Production Support & Incident Management
- Lead initial production issue analysis, incident triage, and troubleshooting.
- Participate in on-call rotations and respond to critical infrastructure incidents.
- Perform root cause analysis (RCA) and prepare post-incident reports and postmortems.
- Identify recurring operational issues and implement preventive measures to improve system reliability.
- Establish and improve incident response procedures, escalation processes, and operational best practices.
- Drive deployment, rollback, and change-management practices to minimize production risks. 3. Kubernetes & Container Orchestration
- Manage Kubernetes clusters across production environments, including upgrades, maintenance, and configuration.
- Troubleshoot pod failures, node-level issues, networking problems, and cluster performance bottlenecks.
- Configure and optimize ingress controllers, service networking, autoscaling, and workload scheduling.
- Manage containerized workloads and deployment configurations using Helm.
- Ensure efficient allocation and utilization of compute, memory, storage, and GPU resources. 4. Infrastructure Automation & DevOps
- Build and maintain infrastructure automation using Terraform and related Infrastructure as Code (IaC) tools.
- Develop and enhance CI/CD pipelines to streamline deployments and infrastructure changes.
- Automate repetitive operational tasks, infrastructure provisioning, scaling, and deployment workflows.
- Implement reliable deployment and rollback mechanisms.
- Improve operational efficiency through scripting, automation, and standardized infrastructure processes. 5. Monitoring, Observability & Performance Optimization
- Build and maintain monitoring systems, alerts, dashboards, and operational visibility tools.
- Implement observability practices using Prometheus, Grafana, Loki, or equivalent platforms.
- Monitor system health, resource consumption, service availability, and infrastructure performance.
- Define reliability metrics and establish appropriate service-level objectives (SLOs).
- Continuously optimize infrastructure performance, availability, and operational efficiency. 6. Capacity Planning & Disaster Recovery
- Conduct infrastructure capacity planning to support growing workloads and increasing compute requirements.
- Develop and maintain disaster recovery strategies and infrastructure resilience mechanisms.
- Identify scalability requirements and plan infrastructure improvements proactively.
- Ensure production systems can handle workload fluctuations and unexpected failures. Must-Have Skills & Qualifications
- Experience in Site Reliability Engineering, DevOps, Platform Engineering, or Infrastructure Engineering.
- Robust hands-on experience operating and maintaining Kubernetes clusters in production environments.
- Practical knowledge of Kubernetes upgrades, ingress, networking, autoscaling, scheduling, and cluster troubleshooting.
- Strong Linux administration and system troubleshooting skills.
- Solid understanding of networking fundamentals, in
📌 Site Reliability Engineer (Bengaluru)
🏢 Weekday AI
📍 Bengaluru