Position Title:Responsible AI / Eval Specialist
Position Type: Regular - Full-Time
Requisition ID: 43986
In every role, McCainers are ambitious, curious, and passionate about creating exceptional work experiences - together. With a customer-first mindset, we make doing business with McCain easy.
About the role.
The Responsible-AI / Eval Specialist is responsible for designing, implementing, and operating evaluation frameworks that determine whether AI use cases are ready to progress through governance stage-gates and into production. This role serves as the hands-on execution arm of McCain’s Responsible AI standards, working closely with AI Platform & Engineering, Knowledge Engineering, Forward Deployment Engineers, and Security teams to evaluate accuracy, reliability, fairness, robustness, and overall quality across the McCain AI ecosystem. The role supports AI solutions built on Azure, Anthropic foundation models, Distyl technologies, Databricks, SAP, Salesforce, and other enterprise platforms.
What you’ll be doing.
Design and execute evaluation strategies for AI use cases,
including assessments of accuracy, reliability, hallucination rates, fairness, and robustness.
Build, maintain, and operate evaluation harnesses, benchmark suites, and golden datasets across the McCain AI technology stack.
Conduct stage-gate evaluations and provide explicit, actionable findings to support governance decisions.
Run bias and fairness testing across protected attributes and business-relevant user groups.
Identify, quantify, and communicate fairness concerns while recommending practical remediation approaches.
Lead red-team and adversarial testing exercises to identify vulnerabilities, failure modes, prompt injection risks, and jailbreak scenarios.
Partner with Enterprise Security teams to strengthen AI resilience through broader adversarial testing initiatives.
Support risk classification activities by providing evaluation evidence and recommendations that inform governance decisio
📌 Responsible AI (Gurugram)
🏢 .
📍 Gurugram