13 Aug
|
Welldoc
|
Bengaluru
Job Title
AI Model Quality Engineer – Healthcare (Wellness & Digital Health)
Location: Bangalore
Experience
6 - 12+ years overall experience
3+ years in ML / AI model testing, validation, or governance
Role Overview
We are seeking an AI Model Quality Engineer to ensure trustworthiness, safety, reliability, and regulatory compliance of AI/ML models used in our platform.
This role sits at the intersection of Quality Engineering, Data Science, Responsible AI, and Healthcare Compliance.
You will serve as the independent validation authority within the Model Development Life Cycle (MDLC). Functioning as a strategic partner to—but distinct from—the Model Development team, you will ensure strict separation of concerns by owning the objective validation gates between "ML Model Testing" and "Clinical Handoff". You will be responsible for certifying that models meet all defined acceptance criteria before they are exposed to clinical evaluators or production traffic.
Key Responsibilities
1. Model Quality, Validation, & "Shift Left" Strategy
- Requirements Definition:
Partner with Clinical and Product teams during the Requirement Gathering phase to translate clinical goals into quantifiable technical acceptance criteria (e.g., defining specific thresholds for False Negatives, bias limits, or hallucination rates).
- Golden Set Management: Create, maintain, and secure "Golden Datasets" and "Adversarial Test Sets" that are isolated from the training process, ensuring true out-of-sample validation.
- Test Execution: Design and execute test strategies for AI/ML models (predictive, classification, recommendation, and GenAI/LLM-based systems).
- Comprehensive Validation: Validate model behavior across accuracy, bias, robustness, stability, and safety using independent test pipelines.
2. Engineering & Clinical Handoffs
- API Contract Validation: Validate model artifacts (containers, APIs) during the Non-production Model Deploy phase to ensure latency, throughput, and error handling
📌 AI Model Quality Engineer (Bengaluru)
🏢 Welldoc
📍 Bengaluru