JOB DESCRIPTION
– AI Evaluation Lead / Principal Consultant Role Summary We are looking for an AI Evaluation Lead / Principal Consultant to own the strategy, methodology, commercial growth, and leadership direction of the AI Evaluation practice. This is a senior leadership role focused on scaling AI quality capabilities, building flagship accounts, shaping enterprise AI evaluation programs, and establishing thought leadership in AI assurance. Experience Required 12+ years of total experience. Candidates should have 5+ years of experience in AI, ML, NLP, LLMs, AI quality, enterprise AI delivery, AI evaluation, or AI assurance, with 3+ years in team leadership, practice leadership, or senior client advisory roles. ? Share

your profile
at: [email protected]

Key Responsibilities
• Define and own the AI Evaluation practice strategy, operating model, methodology direction, and quality standards.
• Build and scale enterprise AI evaluation offerings across voice AI, chatbots, LLM applications, agentic AI, and multimodal AI.
• Own flagship client relationships and engage senior executives on AI quality, AI risk, and AI assurance.
• Shape high-value AI evaluation programs for enterprise clients.
• Define commercial models, effort estimation approaches, delivery structures, and margin discipline for evaluation engagements.
• Lead solutioning, proposals, presales discussions, and strategic account expansion.
• Build reusable frameworks for hallucination testing, robustness testing, red teaming, safety evaluation, compliance evaluation, and regression testing.
• Guide L3/L2 leaders and develop the leadership bench for the evaluation practice.
• Own hiring strategy, senior talent development, and succession planning.
• Identify new market opportunities, domains, modalities, partnerships, and adjacent offerings.
• Represent the practice externally through industry forums, client workshops, publications, advisory discussions,



and thought leadership.
• Drive methodology adoption internally and externally.
• Ensure delivery quality, client satisfaction, revenue growth, and long-term practice scalability. Required Knowledge and Skills Expert-level understanding of AI evaluation, LLM evaluation, AI quality, conversational AI, and enterprise AI assurance.
• Solid knowledge of hallucination evaluation, robustness testing, safety testing, red teaming, responsible AI, and compliance-oriented evaluation.
• Strong understanding of enterprise AI delivery models, AI lifecycle risks, governance, and quality assurance.
• Strong executive stakeholder management and consultative selling ability.
• Proven experience building teams, practices, offerings, or large-scale delivery capabilities.
• Ability to define commercial strategy, pricing approach, delivery economics, and account growth plans. Strong methodology design and thought leadership capability.
• Ability to mentor senior practitioners and create successors.
• Strong communication, executive presentation, negotiation, and strategic planning skills.
• Ability to work across delivery, product, sales, client leadership, and partner ecosystems. Preferred Skills
• Experience leading an AI testing, AI quality, AI assurance, AI governance, or AI evaluation practice.
• Experience with AI evaluation and testing platforms.
• Strong network in AI, digital transformation, quality engineering, or enterprise technology.
• Experience publishing thought leadership, white papers, case studies, or speaking at industry events.
• Experience in regulated industries such as BFSI, healthcare, insurance, automotive, or telecom.
• Exposure to Responsible AI frameworks, model risk management, AI governance, and regulatory compliance. Educational Qualification B.
E. / B.
Tech / M.
Tech / M.
S. in Artificial Intelligence, Computer Science, Computer Engineering, Information Technology, or related Computer discipline.

📌 AI Evaluation Lead (Bengaluru)
🏢 QualityKiosk Technologies
📍 Bengaluru