About Position:

We are seeking an AI Test Engineer with 8-14 years of experience in Software Testing, Test Automation, and AI/Generative AI validation. The ideal candidate will be responsible for ensuring the quality, reliability, safety, and correctness of AI-powered applications across the software development lifecycle. This role requires expertise in testing Large Language Models (LLMs), Agentic AI solutions, prompt engineering workflows, AI integrations, and automated testing frameworks.
- Role: Test Engineer
- Location: Bangalore
- Experience: 8 to 14 years
- Job Type: Full Time Employment

What You'll Do:
- Design and execute comprehensive test strategies for Generative AI and Agentic AI applications.
- Validate LLM outputs for accuracy, bias, hallucinations, safety, and consistency.
- Test prompt versions and evaluate AI behavior changes across model updates.
- Develop and maintain automated test frameworks for AI-enabled applications.
- Execute functional, regression, integration, performance, and non-functional testing.
- Test AI integrations, APIs, workflows,



and external service connections.
- Perform regression testing for AI model updates, prompt changes, and version upgrades.
- Collaborate with developers, AI engineers, and product teams to establish quality gates.
- Create and manage test datasets for AI validation and benchmarking.
- Monitor AI application performance and identify risks related to model drift and output quality.
- Support CI/CD quality gates and automated validation pipeline

Expertise You'll Bring:
- Strong experience in Manual and Automation Testing.
- Hands-on experience with AI/Generative AI testing.
- Strong understanding of Large Language Models (LLMs) and AI application behavior.
- Experience validating AI outputs for accuracy, safety, bias, and hallucinations.
- Knowledge of Agentic AI systems and workflow testing.
- Experience with Selenium and Playwright automation frameworks.
- Robust API testing experience using tools s

📌 Test Engineer (Bengaluru)
🏢 Persistent
📍 Bengaluru