Position Summary
This role owns agent reliability, observability, and trust controls. Monitors system health, trace logs, response quality, and hallucination signals; establishes detection thresholds and alerts. Works closely with the AI platform team to diagnose issues, improve guardrails, and ensure stable, compliant operation in production
AI Engineer will:
- Monitor data changes in ServiceNow-SNOW (Views in Databricks) for any inconsistencies that affect agents’ reliability.
- Controls and monitors data access points (SNOW/Azure/unstructured data, Documentation etc)
- Consults proposed changes with Tech/Business.
- Design and develops quick changes to data pipelines, agents, interfaces
- Trains end users on prompt usage and best practices; tests and refines existing prompts; identifies recent prompts aligned to evolving business needs. Partners with the Business Product Owner to ensure a closed-loop learning system, where user feedback, agent performance metrics, and production outcomes are systematically incorporated to improve prompt effectiveness and accuracy.
- Ensures prompts are strictly scoped to Master Control Framework (MCF) - defined domains, controls, and measures, preventing drift into non-authoritative logic.
- Confirms that agent responses triggered by prompts map directly to defined MCF elements such as control IDs and calculation logic. Validates reliance on MCF-authoritative data sources and enforces refusal or escalation behaviour when queries fall outside MCF scope or require human judgment.
- Translates user feedback insights into prioritized enhancement requests.
- Partners with Tech to improve agent usability, response clarity, and front-end experience without altering approved business logic.
- Translates business needs into deliverable increments, and ensures alignment across architecture, security, and platform standards
- The role combines technical knowledge and expertise (hands-on) with functional knowledge of Risk management.
Responsi
📌 Assistant Manager-AI Engineer (Bengaluru)
🏢 GSK
📍 Bengaluru