Responsibilities:
Design and implement UI automation frameworks for React-based healthcare applications
Automate testing of digital avatar interactions and real-time visualizations
Test ADA-compliant features and responsive design across devices
Automate WebRTC audio/video streams and real-time communication testing
Test software to ensure responsiveness and efficiency
Test real-time database operations (Fire store, Cloud SQL)
Validate session metadata, audit logs, and complex healthcare data structures
Ensure HIPAA compliance, data encryption, and PII protection
Perform SQL-based testing for healthcare data integration
Execute complex healthcare workflow testing across multiple use cases
Test multi-turn conversational flows and emergency scenario handling
Validate edge cases, stress testing, and session recovery mechanisms
Create comprehensive test scenarios for healthcare compliance
Design and execute test plans for agent behavior across reasoning, tool usage, multi-turn flows, and goal completion
Build and maintain automated testing frameworks for agent workflows using Python
Test for hallucinations, prompt injection, bias, PII leakage, and response safety
Test end-to-end integration between UI, microservices, and AI agents
Self-starter proactive and extremely detail oriented
Validate GCP infrastructure, CI/CD pipelines, and deployment automation
Implement Automated CI/CD processes using Jenkins tools
Perform security testing and telephony platform integrations
Test observability systems and cloud-based microservice environments
Work with observability tools (e.g., LangSmith, Trulens, logging pipelines) to analyze agent execution
Design test strategy and estimates for automation
Technology focused, agnostic to tools, adaptable to change in technology
Suggest quality fixes and improvements
Mentor and guide team members. Collaborate with engineers to iterate on prompt design, tool chaining, and fallback logic




Contribute to the development of agent test harnesses and benchmarking pipelines
Validate message integrity and orchestration between avatar UI, voice services, context managers,
and LLM endpoints using REST/gRPC/WebSocket automation
Implement contract and schema validation for API integrations
Test event-driven architectures using Kafka/MQTT and ensure reliable message delivery
Ensure continuous integration and protected model rollout through MLOps-aware CI/CD testing
Implement model version checks and regression suite hooks in deployment pipelines
Work with Docker, Helm, and GitHub Actions for containerized deployments

Required Skills:
Core Testing Automation:
3+ years QA automation experience with Selenium WebDriver expertise
Java/Python programming for automation frameworks
API Testing proficiency (Rest Assured, Postman, REST/Graph QL APIs)
Event-driven automation (REST/gRPC/WebSocket, Kafka/MQTT testing)
Contract schema validation expertise
Async workflow simulation and event bus testing (Kafka, NATS)
API contract testing tools (Karate, Swagger mocks, pact testing)

Frontend UI Testing:
Strong JavaScript frameworks knowledge (React, Angular, Vue.js)
Multimodal UI automation (Playwright/Cypress for avatar rendering, gestures, text sync)
Visual regression testing tools (Applitools, Percy)
WebDriver with video validation capabilities
Speech Audio testing (ASR/TTS accuracy, latency profiling, ffmpeg pipelines)
Visual Motion regression testing (OpenCV-based comparison, frame analysis)
Accessibility testing tools (Axe-core, Lighthouse, screen reader validation)
End-to-end conversation flow simulation with mock APIs




Cloud Platform:
GCP/AWS cloud platform experience and microservices testing
Docker, Kubernetes containerization and orchestration
Infrastructure testing and deployment validation
Performance testing tools (JMeter, LoadRunner, k6, Locust, Gatling)
CI/CD pipeline testing (Jenkins, GitHub Actions, Helm)
MLOps-aware testing (model version checks, regression suite hooks)
Observability monitoring tools (OpenTelemetry, Grafana, ELK, Prometheus)
Chaos testing and fault injection (Gremlin, synthetic fault testing)
Database caching validation (SQL/NoSQL automation, Redis, schema drift monitoring)

AI Healthcare Specific:
AI/ML testing and conversational AI validation
Healthcare compliance knowledge (HIPAA, FHIR standards)
Security testing for regulated environments
Voice AI and speech recognition testing
LLM endpoint testing and validation
Avatar UI and multimodal interaction testing
Context manager and conversation flow testing

Security Compliance:
Enterprise security standards (HIPAA, SOC2, GDPR) automation
Security testing tools (OWASP ZAP, Burp Suite)
JWT validation and authentication testing
Policy-as-code implementation (OPA)
Secret scanning and vulnerability assessment
Error handling and circuit breaker validation
Evaluate agent output using rubric-based, LLM-based, and scenario-based techniques
LLM-specific testing including prompt testing
Multi-turn conversation testing
Shadow testing and anomaly monitoring experience
Distributed load testing with Grafana integration
Microservice contract chaining expertise
Image diffing and automated snapshot testing
Noise robustness testing for voice interaction

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Associate Technical Engineer - Testing (Mumbai)
🏢 Quantiphi Analytics Solutions
📍 Mumbai