Overview

Verantos (https://verantos.com) is the market leader in high-accuracy real-world evidence (RWE) generation. The Verantos RWE platform integrates heterogeneous real-world data sources and generates evidence with the accuracy necessary for regulatory and reimbursement use. The platform leverages data science and artificial intelligence, along with advanced data sources such as electronic health records (EHR), to generate RWE capable of supporting complex clinical studies. Some of the largest biopharma companies in the world are Verantos customers.

We use a heterogeneous AWS-centric tech stack with data processing, AI, workflows, and analytics. Our teams are cross-functional and cooperative, bringing together engineering, product, design, QA, and clinical domain experts to deliver meaningful, real-world impact.

This position is open only to candidates currently based in Pune.

Description

We're looking for a Senior SDET to own end-to-end quality for assigned product features across web apps and backend APIs, with a strong focus on evaluating AI/LLM-powered workflows.



You'll build CI-gated automation and evaluation harnesses — covering UI, API, and non-deterministic AI agent behavior — set testing standards for the team, and drive a shift-left quality culture with engineering and product teams.

Responsibilities
- Design and maintain Python-based test automation frameworks for UI (Playwright) and REST APIs — reusable, scalable, and maintainable across the team's test suites
- Build automated evaluation suites for AI/LLM-powered features — tracking output correctness, hallucination rate, and regression across model/prompt versions — using tools such as Langfuse, Ragas, or equivalent
- Collaborate with engineering leads to define and integrate CI/CD quality checks in GitHub Actions — wiring test suites and evaluation runs into the pipeline and agreeing on pre-merge gates that block on failed tests, evaluation-score thresholds, or schema-compatibility issues

📌 Senior SDET (Pune)
🏢 Verantos
📍 Pune