Job Title: Testing Lead – Deep Learning / LLM / VLM
Location
Remote / Hybrid / In office

Experience
3–4 years (hands-on ownership in DL / LLM / GenAI testing)

Employment Type
Full-time

Role Overview
We are seeking a
hands-on Testing Lead
to own quality and
documentation
for our Deep Learning, LLM, and Vision-Language Model (VLM) products. You will define how we test, measure, document, and communicate AI quality—working closely with ML, Engineering, and Product teams in a fast-paced startup environment.

This role is ideal for someone who believes
clear documentation is as critical as good testing
, especially for non-deterministic AI systems.

What You’ll Do
Own Quality & Documentation End-to-End
- Define testing strategy for LLMs, VLMs, and DL pipelines.
- Create and maintain clear, lightweight documentation covering:
- Model testing strategies and assumptions
- Evaluation metrics and acceptance criteria
- Known limitations, risks, and failure modes
- Release readiness and quality sign-off
- Ensure documentation evolves with models, data, and prompts.





LLM / GenAI Testing
- Design tests for:
- Prompt templates and prompt changes
- RAG pipelines (retrieval quality, grounding, hallucination control)
- Multi-turn conversations and long-context behaviour
- Maintain golden datasets, regression test suites, and test result summaries.
- Document prompt behaviour, edge cases, and known model quirks.

Vision & Multimodal Testing
- Test VLMs for image-text alignment, OCR, captioning, and reasoning.
- Document model performance across different image types, quality levels, and domains.
- Track and publish model behaviour changes between versions.

Automation, MLOps & Reporting
- Build Python-based automation for evaluation and regression testing.
- Integrate tests into CI/CD and MLOps pipelines.
- Produce readable quality reports and dashboards for engineers and leadership.
- Monitor and document production issues such as model/data drift and degradation.

Build a Quality-F

📌 Testing Lead-QA (Bengaluru)
🏢 Teleradiology Solutions
📍 Bengaluru