Company Name: VARITE India Private Limited

About The Client:

An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.

About The Job:
- The Senior AI Validation Engineer is the critical authority responsible for the safety, accuracy, and fairness of enterprise AI systems.
- This role designs and executes rigorous evaluation frameworks for both deterministic ML models and non-deterministic LLM agents. By leading A/B testing, bias detection, and continuous LLM evaluation, you will establish the statistical guardrails required to scale AI securely and prevent model degradation, hallucinations, and data drift in production

Essential Job Functions:




- Architect comprehensive offline evaluation pipelines, stress testing, and adversarial testing methodologies for complex AI and RAG architectures.
- Implement continuous evaluation suites using frameworks like Ragas or Giskard to measure context recall, answer faithfulness, and agile agent trajectory logic.
- Red-team models to uncover vulnerabilities, hidden biases, and policy violations, ensuring enterprise compliance and fair outcomes across different demographic slices.
- Develop automated statistical tests to identify training-serving skew, anomalous inputs, and data degradation that could compromise model integrity.
- Lead A/B testing methodologies to confidently compare model iterations, validate prompt engineering improvements, and prove statistical significance in performance gains.
- Act as the final technical owner for AI production readiness. Dictate go/no-go deployment decisions and enf

📌 Python+ML (Bengaluru)
🏢 VARITE
📍 Bengaluru