Hi All,
Greetings
We're hiring for AGS for the role AI Ops Engineer for more quires kindly reach out -
[email protected]
ROLE: AI Ops Engineer
EXP: 3+ Yrs
LOC: Bangalore
NP: 0 to 30 Days
Mandatory skills: Health Domain
JD for your reference
AIOps Engineer, AI Foundation (LLMOps / Orchestration)
Department: Engineering
Location: Bangalore
Employment Type: Full-time
About the Role
Own the reliable, scalable, and compliant operation of the AI/LLM platform in production. You will run model orchestration and the model gateway/serving layer across multiple providers (AWS Bedrock and others), CI/CD for models and prompts, platform observability, and cost/latency instrumentation - keeping the runtime healthy, auditable, and cheap to run for both the RCM and coding-AI teams.
Key Responsibilities
• Own and manage model orchestration and the model gateway/serving layer across AI providers (Bedrock and others).
• Build and maintain CI/CD pipelines for models, prompts, and AI services - including versioning, rollout, and rollback.
• Monitor platform health through tracing, metrics, logging, alerting, and dashboards.
• Track and drive down cost-per-transaction, throughput, and latency for AI workloads.
• Ensure runtime compliance, auditability, and secure handling of PHI/PII in production.
• Support production deployment and incident resolution for AI workloads across both verticals.
Required Qualifications
• 2+ years overall in software, DevOps, or MLOps engineering, with 1-2 years hands-on operating AI/ML or LLM systems in production.
• Hands-on experience with LLMOps/MLOps concepts and the AI model lifecycle.
• Experience with AWS Bedrock, model gateways, or multi-model orchestration.
• CI/CD pipelines for AI/ML applications (GitHub Actions, Jenkins, or GitLab CI).
• Solid grasp of model/prompt versioning, rollout, and rollback strategies.
• Observability tooling for tracing, logging, metrics, and alerting (Prometheus, Grafana, OpenTelemetry, CloudWatch, o
📌 AI Ops Engineer (Bengaluru)
🏢 AGS Health
📍 Bengaluru