This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Testing Lead-QA based in India.
This is an exciting opportunity for an experienced quality engineering qualified to lead testing initiatives for cutting-edge AI products, including Deep Learning, Large Language Models (LLMs), and Vision-Language Models (VLMs). The role combines technical leadership, test strategy development, and documentation ownership in a fast-paced and innovation-driven environment. You will work closely with machine learning engineers, product teams, and software developers to ensure AI systems are reliable, scalable, and production-ready. This position is ideal for someone who enjoys solving complex quality challenges in non-deterministic systems and building structured processes around emerging technologies. You will play a key role in shaping quality standards, improving AI evaluation methodologies, and fostering a quality-first culture across the organization.

Accountabilities




- Define and lead end-to-end testing strategies for Deep Learning, LLM, and VLM products and pipelines.
- Establish testing frameworks covering model evaluation, acceptance criteria, release readiness, and risk assessment.
- Create and maintain comprehensive documentation related to testing methodologies, model assumptions, known limitations, and quality sign-offs.
- Design and execute testing strategies for prompt engineering, RAG pipelines, hallucination control, multi-turn conversations, and long-context model behavior.
- Develop and manage golden datasets, regression testing suites, and benchmarking processes.
- Evaluate multimodal and vision-language systems, including image-text alignment, OCR, captioning, and reasoning capabilities.
- Build Python-based automation frameworks for model evaluation, validation, and regression testing.
- Integrate testing processes into CI/CD and MLOps pipelines to support continuous delivery and mod

📌 Testing Lead-QA (India)
🏢 Jobgether
📍 India