Role & responsibilities

- Test AI conversations for accuracy, hallucinations and correct source citation

- Check role-based answers, multilingual replies and out-of-scope handling

- Run safety tests such as prompt-injection attempts

- Compare new prompt and model versions against the previous baseline

- Do manual, smoke and regression testing of the dashboard, chat widget and booking flows

- Write test cases and log explicit, reproducible bugs on GitHub

Preferred candidate profile

- Manual testing: test cases, positive/negative and boundary testing, regression, bug life cycle

- LLM testing: hands-on with ChatGPT, Claude or Gemini; understands hallucinations and prompt behaviour

- Prompt engineering basics

- Strong attention to detail and written English

- Clear bug reporting

📌 LLM Test Engineer (Pune)
🏢 Upswing Cognitive Hospitality Solutions
📍 Pune