22 Nov
|
Spydra
|
Hyderabad
About The Role
You will operate resilient, scalable and observable production AI inference services.
Key Responsibilities
• Deploy inference services using Kubernetes, containers and release automation.
• Implement autoscaling, GPU-aware scheduling, load balancing and traffic management.
• Design high availability, disaster recovery, rollback and automated recovery.
• Monitor GPU utilisation, memory, TTFT, throughput, errors and service health.
• Manage incidents, root-cause analysis and performance degradation.
• Define service-level objectives, error budgets, capacity plans and operational runbooks. Tech Stack Kubernetes, Docker, Helm, Argo CD, Prometheus, Grafana, NVIDIA GPU Operator, Python, Linux, CI/CD, observability. Expected Deliverables Reliable inference deployments, monitoring, runbooks and recovery procedures. (ref:hirist.tech)
📌 Spydra - AI Inference Reliability Engineer (Hyderabad)
🏢 Spydra
📍 Hyderabad