AI Test Engineer Insurance

We are looking for a QA/Test Engineer with solid functional testing experience and hands-on exposure to AI/LLM application testing within the insurance domain.

Key Responsibilities
Design, develop, and execute test cases for AI/LLM-based applications.
Validate AI outputs for accuracy, relevance, consistency, safety, and business compliance.
Develop prompts and evaluation scenarios to test AI responses against expected outcomes.
Perform functional, regression, integration, and user acceptance testing for AI-enabled applications.
Identify defects, analyze AI behavior, and work with developers to improve model performance.
Document test strategies, test cases, results, and defect reports.

Required Skills
3+ years of software testing experience with robust functional testing expertise.




Hands-on experience testing GenAI/LLM applications (commercial or internal projects).
Experience creating AI test cases, evaluation datasets, prompts, and expected outputs.
Working knowledge of AI evaluation concepts such as hallucination detection, prompt validation, response quality, bias, and safety testing.
Exposure to one or more AI testing frameworks/tools such as DeepEval, Promptfoo, Garak, or similar.
Solid analytical and communication skills as well as team player

Preferred Qualifications
Experience with Health Insurance or Agency Operations testing is highly Preferred
Basic Python scripting for AI testing is an advantage.
Experience working in Agile/Scrum teams.

📌 Ai Test Engineer Bengaluru
🏢 PURETECH CODEX
📍 Bengaluru