27 Sep
|
e-Solutions
|
Chennai
27 Sep
e-Solutions
Chennai
Criteria:
5+ yrs of testing experience in both Manual & automation
Should have minimum 1 year of experience in AI/ML testing
Valuable Communication skills
NP: Max 15 days
Location: Chennai
Interviews 2 rounds
1st RD Virtual & 2nd RD mandatory f2f
Shift timings: 12 to 9pm & 5 days working from office.
Job Description
Owns technical testing of agent outputs accuracy, turnaround-time impact, and regression testing as agents are iterated feeding the accuracy and completion-time KPIs tracked at the programmer level.
Key Responsibilities:
Build test suites validating agent outputs against golden-record datasets across covered processes.
Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
Feed findings into the human QA function for final sign-off this role supports human QA authority on regulated activity with technical evidence, not replaces it.
Required Experience:
5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
Hands-on experience on working in Real-time project experience in Agentic AI or Generative AI applications.
Experience with API testing and tools such as Postman.
Experience with load and performance testing like Jmeter.
Experience using any of the for defect tracking and management tool like Azure DevOps (ADO) .
Ability to evaluate AI responses for accuracy, relevance, completeness, consistency, and hallucinations.
Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
Domain process familiarity a plus for building realistic test scenarios.
📌 Ai/ml Tester Automation Manual Tester Chennai
🏢 e-Solutions
📍 Chennai