Area(s) of responsibility

.Job Title: Senior AI Test Engineer Experience: 4–5 Years

Location: Hybrid / Onsite

Employment Type: Full time

Key Responsibilities

- Define and implement end-to-end test strategies for AI-enabled applications.
- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
- Perform functional, integration, regression, system, and UAT testing.
- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
- Develop and maintain API automation frameworks.
- Validate AI model responses for:
- Accuracy
- Relevance
- Consistency
- Hallucinations
- Bias
- Toxicity

- Test prompt engineering scenarios and optimize prompt quality.
- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
- Verify AI guardrails, content moderation, and responsible AI compliance.
- Perform database validation using SQL.
- Conduct performance and load testing for APIs and AI services.
- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers

📌 AI Test Engineer -Testing Services (Bengaluru)
🏢 Birlasoft
📍 Bengaluru