Senior AI Engineer

Whitehall Resources currently require an experienced AI Engineer to work with a key client

Role Summary

We are looking for a Senior AI Engineer to design and build App Routing Intelligence Layer and AI cost governance capabilities. The routing layer should determine whether a user request can be handled by a deterministic API, guided workflow, cached response, clarification step, or MuleSoft Agent Fabric. This role is responsible for building the intelligence that enables App to route requests efficiently without making unnecessary LLM calls. The ideal candidate should have solid experience with intent classification, AI routing, LLMOps, evaluation, observability, cost controls, and enterprise AI governance.

Minium Experience

8+ years AI/ML/software engineering, 2+ years LLMOps/GenAI experience

Key Skills

AI/ML, GenAI, LLMOps, Routing Intelligence, Intent Classification, Token Governance, Cost Optimization, AI Observability

Key Responsibilities

* Design and build the App Routing Intelligence Layer.

*




Implement API-first routing logic to reduce unnecessary LLM usage.* Build intent classification and routing strategies using rules, catalogs, lightweight classifiers, and confidence scoring

* Define when ARMI should route to:
- API Engine
- Guided workflow
- MuleSoft Agent Fabric
- Notification Engine
- Clarifying question
- Access denied / policy block
- Define and manage the intent catalog, API action catalog, agent catalog, and routing rules.
- Build cost-aware routing logic to minimise token consumption.
- Design token usage tracking across users, teams, business groups, channels, agents, and models.
- Build telemetry requirements for the token dashboard.
- Define metrics such as LLM avoidance rate, API-first completion rate, agent escalation rate, cache hit rate, and cost per interaction.
- Build evaluation datasets to test routing quality and prevent regressions.
- Collaborate with the Full Stack Developer to implement routing AP

📌 Senior AI Engineer (India)
🏢 Whitehall Resources
📍 India