Company Name: VARITE India Private Limited

About The Client:

A global professional services network and part of the Big Four, along with Client, EY, and KPMG, operating across 149 countries worldwide.

Essential Job Functions:
- Validate AI-powered solutions, including chatbots and generative AI features, for accuracy, reliability, and edge cases.
- Test Retrieval-Augmented Generation (RAG) pipelines for retrieval relevance, grounding, and hallucination handling.
- Build and test agentic AI solutions such as MCP and prompting.
- Curate and version golden/evaluation datasets.
- Validate data pipelines for integrity, completeness, and drift across training and inference.
- Perform AI evaluation using frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge.
- Validate groundedness, relevance, precision, and recall.
- Perform bias, fairness, safety/guardrail, and PII/data-leakage validation.
- Build, scale, and maintain automation frameworks.
- Perform end-to-end UI automation testing across up-to-date web applications.
- Validate REST and GraphQL APIs across microservices.




- Bridge UI and API layers for integrated test coverage.
- Integrate test suites into CI/CD pipelines.
- Perform root cause analysis for complex, multi-system issues.
- Trace failures across services, logs, and data layers.

Qualifications:
- 8+ years of experience in an SDET or QA Engineering role.
- AI Validation & Testing.
- Chatbot Testing.
- Retrieval-Augmented Generation (RAG) Testing.
- LLM/Prompt Evaluation.
- Python Validation.
- Test Data Management.
- Data Quality.
- AI Evaluation.
- RAGAS.
- DeepEval.
- LLM-as-Judge.
- Responsible AI.
- Bias and Fairness Testing.
- Safety Guardrail Validation.
- PII/Data Leakage Validation.
- JavaScript.
- Python.
- Pytest.
- Automation Framework Design.
- UI Automation.
- REST APIs.
- GraphQL APIs.
- Contract Testing.
- Cucumber.
- SpecFlow.
- Postman.
- Insomnia.
- Newman.
- AWS.
- Azure.
- SQL.
- CI/CD Pipelines.
- Jenkins.
- GitHub Actions.
- G

📌 Automation Testing (Bengaluru)
🏢 VARITE
📍 Bengaluru