– AI Evaluation Lead / Principal Consultant

Role Summary We are looking for an AI Evaluation Lead / Principal Consultant to own the strategy, methodology, commercial growth, and leadership direction of the AI Evaluation practice. This is a senior leadership role focused on scaling AI quality capabilities, building flagship accounts, shaping enterprise AI evaluation programs, and establishing thought leadership in AI assurance.

Experience Required

12+ years of total experience. Candidates should have 5+ years of experience in AI, ML, NLP, LLMs, AI quality, enterprise AI delivery, AI evaluation, or AI assurance, with 3+ years in team leadership, practice leadership, or senior client advisory roles.

? Share your profile at: [email protected]

Key Responsibilities

- Define and own the AI Evaluation practice strategy, operating model, methodology direction, and quality standards.
- Build and scale enterprise AI evaluation offerings across voice AI, chatbots, LLM applications, agentic AI, and multimodal AI.
- Own flagship client relationships and engage senior executives on AI quality, AI risk, and AI assurance.
- Shape high-value AI evaluation programs for enterprise clients. • Define commercial models, effort estimation approaches, delivery structures, and margin discipline for evaluation engagements.
- Lead solutioning, proposals, presales discussions, and strategic account expansion.
- Build reusable frameworks for hallucination testing, robustness testing, red teaming, safety evaluation, compliance evaluation, and regression testing.
- Guide L3/L2 leaders and develop the leadership bench for the evaluation practice.
- Own hiring strategy, senior talent development, and succession planning.
- Identify new market opportunities, domains, modalities, partnerships, and adjacent offerings.
- Represent the practice externally through industry forums, client workshops, publications, advisory discussions,



and thought leadership.
- Drive methodology adoption internally and externally.
- Ensure delivery quality, client satisfaction, revenue growth, and long-term practice scalability.

Required Knowledge and Skills

Expert-level understanding of AI evaluation, LLM evaluation, AI quality, conversational AI, and enterprise AI assurance.

- Solid knowledge of hallucination evaluation, robustness testing, safety testing, red teaming, responsible AI, and compliance-oriented evaluation.
- Strong understanding of enterprise AI delivery models, AI lifecycle risks, governance, and quality assurance.
- Strong executive stakeholder management and consultative selling ability.
- Proven experience building teams, practices, offerings, or large-scale delivery capabilities.
- Ability to define commercial strategy, pricing approach, delivery economics, and account growth plans.

Solid methodology design and thought leadership capability.
- Ability to mentor senior practitioners and create successors. • Strong communication, executive presentation, negotiation, and strategic planning skills. • Ability to work across delivery, product, sales, client leadership, and partner ecosystems.

Preferred Skills • Experience leading an AI testing, AI quality, AI assurance, AI governance, or AI evaluation practice.
- Experience with AI evaluation and testing platforms.
- Strong network in AI, digital transformation, quality engineering, or enterprise technology.
- Experience publishing thought leadership, white papers, case studies, or speaking at industry events.
- Experience in regulated industries such as BFSI, healthcare, insurance, automotive, or telecom.
- Exposure to Responsible AI frameworks, model risk management, AI governance, and regulatory compliance.

Educational Qualification B.E. / B.Tech / M.Tech / M.S. in Artificial Intelligence, Computer Science, Computer Engineering, Information Technology, or related Computer discipline.

📌 AI Evaluation Lead (Bengaluru)
🏢 QualityKiosk Technologies
📍 Bengaluru