Job DescriptionSr. DevOps Engineer
nObservability Strategy (Web & AI Applications)
n
n
Design and implement an end-to-end observability & alert stack covering both traditional web applications and AI/ML services.n
Develop and maintain tooling such as Prometheus, Grafana, ELK/OpenSearch, Datadog, or equivalentn
Build AI-specific observability: model latency/throughput tracking, GPU utilization, token usage, drift detection, and inference quality signals.n

nInfrastructure Scaling & Reliability:
n
n
Design and manage infrastructure capable of scaling across on-premise data centers and public cloudn
Own capacity planning, load testing, auto-scaling, and cost-optimization initiatives across compute, storage, and networking.n
Implement Infrastructure as Code (Terraform, Ansible, or equivalent) to ensure settings are reproducible, version-controlled, and auditable.n
Lead disaster recovery, backup, and high-availability strategy for critical systems.n

nDevOps & CI/CD Delivery :
n
n




Partner closely with Solution Architects to translate project and system designs into concrete DevOps execution plans.n
Design, build, and maintain CI/CD pipelines (Jenkins, GitHub Actions orn
ArgoCD/Flux for GitOps) across multiple projects and teams.n
Containerize and orchestrate applications using Docker and Kubernetes, including Helm chart and manifest management.n
Embed security and compliance checks (SAST/DAST, secrets scanning, image scanning) directly into the delivery pipeline (DevSecOps).n

nGPU Infrastructure & Model Deployment
n
n
Provision, configure, and manage GPU infrastructure (on-prem clusters and cloud GPU instances) for modeln
Deploy, scale, and monitor ML/LLM models in production using tools such as Triton Inference Server, vLLM,n
Optimize GPU utilization, cost, and throughput across multi-tenant workloads; manage CUDA/driver/toolkitn
Collaborate with data science/ML engineering teams on MLOps pipelines

📌 Devops Engineer Raigarh (India)
🏢 KnowledgeWorks Global
📍 India