Roles & Responsibilities :
AI Quality Strategy: Develop and own the evaluation framework for GenAI solutions, focusing on Faithfulness, Relevancy, and Hallucination detection using LLM-as-a-judge frameworks.
- Hybrid Test Automation: Architect a dual-layered automation suite:
- Deterministic: E2E UI (Playwright) and API testing (Pytest/Requests).
- Probabilistic: Automated evaluation of non-deterministic LLM outputs.