- Test AI conversations for accuracy, hallucinations and correct source citation
- Check role-based answers, multilingual replies and out-of-scope handling
- Run safety tests such as prompt-injection attempts
- Compare new prompt and model versions against the previous baseline
- Do manual, smoke and regression testing of the dashboard, chat widget and booking flows
- Write test cases and log explicit, reproducible bugs on GitHub
Preferred candidate profile
- Manual testing: test cases, positive/negative and boundary testing, regression, bug life cycle
- LLM testing: hands-on with ChatGPT, Claude or Gemini; understands hallucinations and prompt behaviour
- Prompt engineering basics
- Strong attention to detail and written English
- Clear bug reporting
📌 LLM Test Engineer (Pune)
🏢 Upswing Cognitive Hospitality Solutions
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.