AI Quality and Evaluation, Lead (Pune)

AI Quality and Evaluation, Lead (Pune)

06 Aug
|
QAD
|
Pune

06 Aug

QAD

Pune

Company Description
QAD is building a world-class SaaS company, and we are growing. We are looking for talented individuals who want to join us on our mission to help solve relevant real-world problems in manufacturing and the supply chain.
This hybrid position requires candidates to be based in Pune with 3-4 days of in-office collaboration per week.
Job Description
About the role
QAD's products increasingly include AI agents that make and execute recommendations inside customers' operations. These systems behave differently from traditional software — outputs vary, quality is judgment-based rather than binary, and the cost of getting it wrong matters. We're building the function that makes AI quality measurable, defensible, and continuously improved across our portfolio, and we're hiring the person to own it.
You'll design and run the evaluation framework our AI products are measured against, define the criteria that gate every release, and monitor production performance so quality issues are caught early rather than after customers feel them. The role partners closely with product,



engineering, and customer-facing teams, and reports to the Head of Product Operations.
If you've worked on the quality and measurement side of LLM-based products and want a role where evaluation is genuinely load-bearing rather than an afterthought, this is that role.
What you'll own
Build and own a shared evaluation framework across the product organization: golden datasets, LLM-judge rubrics, and code-based checks. Measure not just response quality but the quality of the decisions the AI products produce — did the recommendation actually serve the customer outcome the product was built for?
Own the technical criteria for stage-gate release reviews: define what evaluation evidence a product must produce to transparent each gate, and each capability-tier progression. You don't chair the gates; the Head does. But a gate cannot pass without your evidence.
Own decision auditability: every AI-dri

📌 AI Quality and Evaluation, Lead (Pune)
🏢 QAD
📍 Pune

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: ai quality and evaluation, lead (pune) / pune

Subscribe to this job alert:

Get the latest job offers by email for: ai quality and evaluation, lead (pune) / pune