The AI Test Engineer ensures quality, reliability, safety, and correctness of AI-enabled systems across the SDLC.
Key Responsibilities:
- Design and execute test strategies for GenAI and Agentic AI apps
- Validate LLM outputs for:
- Accuracy
- Bias
- Hallucinations
- Safety
- Test prompt versions and AI behaviour changes
- Automate functional and non-functional tests
- Test AI integrations
- APIs, and workflows testing
- Perform regression testing for AI model/version changes
- Collaborate with developers on quality gates (both roles need this)
AI-Specific Skills
- Testing LLM (Open AI, Azure) outputs and prompt behaviour
- Understanding of model variability and non-determinism
- Test data management for AI
- Knowledge of responsible AI testing concepts
Default Skills
- Application testing (automation) + Test Data, Test cases preparation
- Test automation frameworks Python, PyTest
- API testing
- CI/CD quality gates
Experience
- 5-8 years in software testing
- Hands-on GenAI / AI testing experience required
📌 AI Test Engineer (Bengaluru)
🏢 Mindsprint
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.