Role Overview
You will be the Quality Intelligence Architect of Exterview.
As a QA Automation Engineer (10+ Years), you’ll design, implement, and own the automation and quality orchestration system that validates AI-driven candidate screening, live interviews, scoring agents, and feedback pipelines.
This is quality engineering at scale: validating probabilistic AI outputs, real-time interview flows, event-driven systems, and media-heavy workflows across thousands of concurrent interviews.
You’ll work closely with Backend, AI Engineering, Prompt Engineering, and Frontend teams to ensure quality is built into the system, not tested after the fact.
Execution is tracked via Linear (tasks), Notion (PRDs & test strategy), and GitHub (automation reviews) ensuring quality decisions are transparent and measurable.
Key Responsibilities
Automation Architecture
- Design and own a scalable, maintainable automation framework for:
- Web (Next.js)
- APIs (GraphQL via AppSync, REST)
- Event-driven and async workflows
- Move QA from test execution to quality architecture ownership.





AI & Probabilistic System Validation
- Validate:
- Resume parsing accuracy
- AI scoring consistency
- Interview logic stability
- Define assertion strategies for non-deterministic AI outputs.

Real-Time & Media Workflow Testing
- Test live interview systems:
- VideoSDK + Tavus video flows
- Real-time state updates
- Validate video upload, playback, retries, and failure handling.

API, Event & Integration Testing
- Build API-first automation for:
- GraphQL queries & mutations
- Lambda & microservice APIs
- Validate event-driven flows (notifications, interview state transitions).

Performance, Load & Reliability Testing
- Design load and stress tests for:
- Interview orchestration APIs
- Video playback & report generation
- Ensure system reliability under peak concurrency.

CI/CD & Quality Gates
- Integrate automation into GitHub Actions.
- Define release quality gates and production sign-off criteria.
- Tr

📌 QA automation engineer (Hyderabad)
🏢 Exterview
📍 Hyderabad