Area(s) of responsibility
.Job Title: Senior AI Test EngineerExperience: 4–5 YearsLocation: Hybrid / OnsiteEmployment Type: Full time
Key Responsibilities

Define and implement end-to-end test strategies for AI-enabled applications.
Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
Perform functional, integration, regression, system, and UAT testing.
Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
Develop and maintain API automation frameworks.
Validate AI model responses for:

Accuracy
Relevance
Consistency
Hallucinations
Bias
Toxicity

Test prompt engineering scenarios and optimize prompt quality.
Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
Verify AI guardrails, content moderation, and responsible AI compliance.
Perform database validation using SQL.
Conduct performance and load testing for APIs and AI services.
Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers

📌 AI Test Engineer (Bengaluru)
🏢 Birlasoft
📍 Bengaluru