Responsibilities

- Test AI conversations for accuracy, hallucinations and correct source citation

- Check role-based answers, multilingual replies and out-of-scope handling

- Run safety tests such as prompt-injection attempts

- Compare new prompt and model versions against the previous baseline

- Do manual, smoke and regression testing of the dashboard, chat widget and booking flows

- Write test cases and log clear, reproducible bugs on GitHub

Must-have Skills

- Manual testing: test cases, positive/negative and boundary testing, regression, bug life cycle

- LLM testing: hands-on with ChatGPT, Claude or Gemini; understands hallucinations and prompt behaviour

- Prompt engineering basics

- Strong attention to detail and written English

- Transparent bug reporting

Pay: From ₹10,000.00 per month

Work Location: In person

📌 LLM Test Engineer / AI Evaluation Engineer (Pune)
🏢 Upswing Cognitive Hospitality Solutions
📍 Pune