This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior QA AI Engineer based in India.

This role leads quality engineering and AI testing initiatives for reliable, scalable, and secure cloud-based software solutions.
You will design advanced testing strategies for backend services, APIs, AI-powered features, and microservices architectures.
A key focus will be validating large language model behavior, agentic AI workflows, security risks, and non-deterministic outputs.
You will build automated evaluation frameworks that integrate quality controls directly into up-to-date CI/CD pipelines.
Working closely with product, engineering, and machine learning teams, you will influence requirements, release quality, and technical standards.
The role also provides an opportunity to mentor engineers and drive continuous improvements in quality engineering practices.
You will contribute to responsible AI adoption while helping deliver resilient technology for complex risk and decision-making environments.

n





Accountabilities:

• Lead quality engineering and AI testing initiatives to ensure software solutions are reliable, scalable, secure, and production-ready across cloud-based platforms.

• Design, develop, and maintain automated test suites for Java-based backend services and REST APIs, supporting consistent quality across development and release cycles.

• Own testing strategies for AI-powered features, including large language model output validation, regression baselines, tool-call accuracy, context management, and end-to-end integration testing.

• Develop continuous integration evaluation frameworks for non-deterministic AI outputs using rubric-based scoring, automated prompt regression suites, and behavioral drift detection.

• Collaborate with product owners, software engineers, and machine learning engineers to establish testable requirements, review acceptance criteria, and maintain quali

📌 Senior QA AI Engineer (India)
🏢 Jobgether
📍 India