Noida, Uttar PradeshBengaluru, Karnataka
Job Summary
Design and execute test strategies for MCP server endpoints, AI reasoning layer, and Streamlit UI
- Build automated regression suites for LLM output quality, accuracy, and consistency
- Validate RAG pipeline responses against runbook ground truth and baseline thresholds
- Perform API contract testing for DB Run, ServiceNow, and MCP tool integrations
- Conduct performance and load testing for multi-agent orchestration workflows
- Manage test environments and coordinate with GCP DevOps for CI/CD test gates
Key Responsibilities
NA
Skill Requirements
Test automation: pytest, Selenium, Playwright
- API testing: Postman, REST-assured, FastAPI test client
- Python scripting for test harness development
- CI/CD integration: GitHub Actions, Jenkins pipelines
- Performance testing: Locust, k6, JMeter
- AI/LLM output validation and regression testing
- Docker, Kubernetes basics for test Environments