About The Role

We are looking for an experienced Senior Test Engineer AI with strong expertise in software quality engineering, test automation, backend validation, and AI/ML system testing. This role requires a quality-focused engineer who can validate both deterministic software systems and probabilistic AI-powered experiences in highly scaled production environments.

The role is focused on defining and implementing test strategies for AI platform capabilities, LLM-based applications, RAG pipelines, AI agents, model integrations, backend services, and data-driven workflows. The ideal candidate should be comfortable working with Polyglotic backend systems, automation frameworks, APIs, cloud-native platforms, and AI evaluation approaches.

We require a candidate with solid analytical thinking, attention to detail, and the ability to collaborate closely with AI engineers, backend engineers, product managers, DevOps, security, and business stakeholders. The candidate should be capable of building scalable quality frameworks that support safe, reliable, measurable,



and production-ready AI features.

Key Responsibilities

Define and implement end-to-end test strategies for AI-powered applications, AI platform services, LLM integrations, RAG pipelines, AI agents, and backend systems.
Design, build, and maintain automated test frameworks for APIs, microservices, AI workflows, model inference services, data pipelines, and event-driven systems.
Validate AI outputs for correctness, relevance, consistency, groundedness, safety, hallucination risk, toxicity, bias, business accuracy, and user experience quality.
Build evaluation suites using golden datasets, prompt test banks, expected response patterns, scoring rubrics, regression checks, and automated quality metrics.
Test RAG pipelines, including document ingestion, chunking, embedding generation, vector search relevance, context retrieval, answer quality, citations, and fallback behavior.
Perform functional, integration,

📌 Senior Test Engineer (Bengaluru)
🏢 Information Technology
📍 Bengaluru