Job Title: Testing Lead – Deep Learning / LLM / VLM

Location

Remote /
Hybrid / In office

Experience

3–4 years
(hands-on ownership in DL / LLM / GenAI testing)

Employment Type

Full-time

Role Overview

We are
seeking a hands-on Testing Lead to own quality and documentation for our Deep Learning, LLM, and Vision-Language Model (VLM) products. You will
define how we test, measure, document, and communicate AI quality—working
closely with ML, Engineering, and Product teams in a fast-paced startup
environment.

This role
is ideal for someone who believes explicit documentation is as critical as valuable
testing, especially for non-deterministic AI systems.

What You’ll Do

Own Quality & Documentation End-to-End
Define testing strategy for LLMs,
VLMs, and DL pipelines.
Create and maintain clear,
lightweight documentation covering:
Model testing strategies
and assumptions
Evaluation metrics and
acceptance criteria
Known limitations, risks,
and failure modes
Release readiness and
quality sign-off
Ensure documentation evolves
with models, data,



and prompts.

LLM / GenAI Testing
Design tests for:
Prompt templates and prompt
changes
RAG pipelines (retrieval
quality, grounding, hallucination control)
Multi-turn conversations
and long-context behaviour
Maintain golden datasets,
regression test suites, and test result summaries.
Document prompt behaviour,
edge cases, and known model quirks.

Vision & Multimodal Testing
Test VLMs for image-text
alignment, OCR, captioning, and reasoning.
Document model performance
across different image types, quality levels, and domains.
Track and publish model
behaviour changes between versions.

Automation, MLOps & Reporting
Build Python-based
automation for evaluation and regression testing.
Integrate tests into CI/CD
and MLOps pipelines.
Produce readable quality
reports and dashboards for engineers and leadership.
Monitor and document
production issues such as model/data drift and degradation.

Build a Qual

📌 Testing Lead Qa Bengaluru
🏢 Telradsol
📍 Bengaluru