Responsibilities:
Design and own the end-to-end functional test strategy for the voice runtime covering call ingress, ASR/TTS partners, router and middleware, multi-agent orchestration, tool/API calls, downstream system integrations, and call termination. Build and maintain integration test suites that exercise the full graph of services, including partner APIs (Eleven Labs, Decagon), internal microservices, queues/streams, databases, and downstream business systems. Define and enforce environment readiness: dev, staging, UAT, pre-prod, and prod. Build environment health checks, configuration drift detection, and smoke tests that gate every deploy. Own production sanity testing synthetic call flows, heartbeat checks, post-deploy validations, and the runbooks the on-call team uses to confirm a release is healthy. Build regression suites that catch functional breakage from agent definition changes, prompt updates, SOP edits, tool changes, and routing rule changesnot the answer quality itself, but whether the system still flows correctly end-to-end.



Triage production incidents from a functional / integration angle, convert them into automated regression tests, and feed signal back to the runtime, platform, and partner integration teams. Partner with the AI engineering and data science teams who own answer quality and evals to ensure their eval pipelines have stable environments to run against and that functional regressions never silently corrupt eval results. Requirements:
5-8 years in functional, integration, and end-to-end QE on complex distributed systems, microservices, queues, third-party API integrations, and multi-environment deployments . Strong API-level test automation (REST, g RPC, webhooks, event-driven) using tools like REST Assured, pytest, Postman/Newman, Karate, or equivalents . Demonstrated ownership of setting readiness and release certification; you have been the person who decides whether a release ships . Experience testing systems with heavy

📌 Senior quality assurance automation engineer (Gurugram)
🏢 Questhiring
📍 Gurugram