Role Overview
You will be the Quality Intelligence Architect of Exterview.
As a QA Automation Engineer (10+ Years), you’ll design, implement, and own the automation and quality orchestration system that validates AI-driven candidate screening, live interviews, scoring agents, and feedback pipelines.
This is quality engineering at scale: validating probabilistic AI outputs, real-time interview flows, event-driven systems, and media-heavy workflows across thousands of concurrent interviews.
You’ll work closely with Backend, AI Engineering, Prompt Engineering, and Frontend teams to ensure quality is built into the system, not tested after the fact.
Execution is tracked via Linear (tasks), Notion (PRDs & test strategy), and GitHub (automation reviews) ensuring quality decisions are transparent and measurable.
Key Responsibilities
Automation Architecture
Design and own a scalable, maintainable automation framework for:
Web (Next.js)
APIs (GraphQL via AppSync, REST)
Event-driven and async workflows
Move QA from test execution to quality architecture ownership.
AI & Probabilistic System Validation
Validate:
Resume parsing accuracy
AI scoring consistency
Interview logic stability
Define assertion strategies for non-deterministic AI outputs.
Real-Time & Media Workflow Testing
Test live interview systems:
VideoSDK + Tavus video flows
Real-time state updates
Validate video upload, playback, retries, and failure handling.