Company Name: VARITE India Private Limited

About The Client:

A global skilled services network and part of the Big Four, along with Client, EY, and KPMG, operating across 149 countries worldwide.

Essential Job Functions:
Validate AI-powered solutions, including chatbots and generative AI features, for accuracy, reliability, and edge cases.
Test Retrieval-Augmented Generation (RAG) pipelines for retrieval relevance, grounding, and hallucination handling.
Build and test agentic AI solutions such as MCP and prompting.
Curate and version golden/evaluation datasets.
Validate data pipelines for integrity, completeness, and drift across training and inference.
Perform AI evaluation using frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge.
Validate groundedness, relevance, precision, and recall.
Perform bias, fairness, safety/guardrail, and PII/data-leakage validation.
Build, scale, and maintain automation frameworks.
Perform end-to-end UI automation testing across up-to-date web applications.
Validate REST and GraphQL APIs across microservices.




Bridge UI and API layers for integrated test coverage.
Integrate test suites into CI/CD pipelines.
Perform root cause analysis for complex, multi-system issues.
Trace failures across services, logs, and data layers.

Qualifications:
8+ years of experience in an SDET or QA Engineering role.
AI Validation & Testing.
Chatbot Testing.
Retrieval-Augmented Generation (RAG) Testing.
LLM/Prompt Evaluation.
Python Validation.
Test Data Management.
Data Quality.
AI Evaluation.
RAGAS.
DeepEval.
LLM-as-Judge.
Responsible AI.
Bias and Fairness Testing.
Safety Guardrail Validation.
PII/Data Leakage Validation.
JavaScript.
Python.
Pytest.
Automation Framework Design.
UI Automation.
REST APIs.
GraphQL APIs.
Contract Testing.
Cucumber.
SpecFlow.
Postman.
Insomnia.
Newman.
AWS.
Azure.
SQL.
CI/CD Pipelines.
Jenkins.
GitHub Actions.
G

📌 Automation Testing Bengaluru
🏢 VARITE
📍 Bengaluru