Company: Trigyn Technologies
Position: AI Testing Consultant(Foundry)
Job Type: Contractual (6 Months Extendable)
Location: Remote
Shift: Until Noon EST

Job Overview

Trigyn is hiring an AI Testing Consultant with strong expertise in AI evaluation concepts, GenAI validation, and AI agent testing. The ideal candidate should possess a solid understanding of AI quality evaluation techniques including groundedness, hallucination detection, accuracy measurement, text similarity, correctness validation, and model drift analysis.

While exposure to Microsoft AI Foundry evaluators is preferred, deep tool-specific experience is not mandatory. Candidates with strong AI evaluation fundamentals and hands-on testing experience in GenAI or AI-driven applications will be highly preferred.

Key Responsibilities

- Perform testing and validation of AI agents, GenAI applications, and prompt-based systems.
- Execute functional, non-functional, and scenario-based testing for AI workflows.
- Evaluate AI responses using metrics such as:
- Groundedness
- Hallucination detection
- Accuracy
- Relevance
- Correctness
- Text similarity
- Completeness
- Model drift

- Analyze AI outputs and identify risks, gaps, inconsistencies, and improvement areas.




- Validate AI responses against business requirements and expected behaviors.
- Support testing of single-agent and multi-agent AI workflows.
- Collaborate with developers, architects, and business teams for defect analysis and resolution.
- Document evaluation findings, test scenarios, and AI performance observations.

Required Skills

- 5+ years of experience in QA, AI testing, GenAI validation, or intelligent automation testing.
- Hands-on experience testing:
- AI Agents
- Chatbots
- LLM/GenAI applications
- Prompt-driven systems

- Strong understanding of AI evaluation metrics and validation methodologies.
- Knowledge of:

- Hallucination detection
- Groundedness validation
- AI response accuracy
- Semantic/text similarity
- AI correctness evaluation
- Model drift concepts

- Strong analytical and troubleshooting capabilities.
- Valuable communication and documentation skills.

Preferred Skills

- Exposure to Microsoft AI Foundry evaluators.
- Experience with Copilot Studio or agentic AI frameworks.
- Familiarity with multi-agent orchestration testing.
- Experience working in enterprise AI governance environments.

Interested candidates, please share your resume on [email protected] or Whatsapp on +91 (phone hidden).

📌 AI Testing (Foundry) - Remote Contract Position (Mumbai)
🏢 Trigyn Technologies
📍 Mumbai