- Robust understanding of RAG & agentic system architecture
- Ability to develop AI Assurance test strategy to assess AI systems for quality, safety, reliability and responsible AI behavior
- Design AI evaluation strategy for LLMs, RAG and agent evaluation across functional and non-functional dimensions
- Experience in Golden dataset curation & Synthetic dataset generation
- Experience in implementing AI evaluation frameworks like Ragas, DeepEval, etc.
- Experience in using AI Evaluation tools like LangSmith, Arize, Langfuse, Galileo, Evidently, etc.
- Experience in instrumentation to establish AI Observability / tracing using OTEL libraries
- Experience in Integrating AI evaluation into CI/CD pipeline
- Experience in Responsible AI validation
- Knowledge of regulatory considerations for AI systems
📌 AI Testing (Hyderabad)
🏢 Hexaware Technologies
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.