AI Test Engineer Insurance

We are looking for a QA/Test Engineer with strong functional testing experience and hands-on exposure to AI/LLM application testing within the insurance domain.

Key Responsibilities

- Design, develop, and execute test cases for AI/LLM-based applications.

- Validate AI outputs for accuracy, relevance, consistency, safety, and business compliance.

- Develop prompts and evaluation scenarios to test AI responses against expected outcomes.

- Perform functional, regression, integration, and user acceptance testing for AI-enabled applications.

- Identify defects, analyze AI behavior, and work with developers to improve model performance.

- Document test strategies, test cases, results, and defect reports.

Required Skills

- 3+ years of software testing experience with robust functional testing expertise.





- Hands-on experience testing GenAI/LLM applications (commercial or internal projects).

- Experience creating AI test cases, evaluation datasets, prompts, and expected outputs.

- Working knowledge of AI evaluation concepts such as hallucination detection, prompt validation, response quality, bias, and safety testing.

- Exposure to one or more AI testing frameworks/tools such as DeepEval, Promptfoo, Garak, or similar.

- Strong analytical and communication skills as well as team player

Preferred Qualifications

- Experience with Health Insurance or Agency Operations testing is highly Preferred

- Basic Python scripting for AI testing is an advantage.

- Experience working in Agile/Scrum teams.

📌 AI Test Engineer (Bengaluru)
🏢 PURETECH CODEX
📍 Bengaluru