- Decide what to test and in what order, from risk: what would hurt the client most if it broke, and what is most likely to be broken.
- Explore beyond the specification. The defects that matter live where nobody wrote a test case.
- Judge severity honestly and write findings people act on: reproduction steps, expected versus actual, evidence attached. One well-documented critical bug beats ten vague ones.

Testing AI systems

- Build and maintain evaluation sets for our agentic and LLM-backed features, and calibrate the automated judges against your own reading.
- Validate computer vision work the way it fails in the field: false positives and false negatives, rare classes, bad lighting, the last twenty percent. Confidence is not correctness.
- Re-test when models or data change, and catch drift before the client does.

Using the machines

- Run AI-assisted testing tools for breadth: generated cases, self-healing suites, wide regression. You direct them and audit what they produce.
- Evaluate AI-generated tests with the same skepticism as AI-generated anything: fluent output is not correct output.
- Work inside the automation infrastructure our test automation engineer builds.



That role owns the frameworks and the CI; you own what to test, what the evidence shows, and whether it ships.

Honest evidence

- Your output is the truthful state of the system, in writing, every week: what works, what does not, what is untested.
- When something is broken two days before a deadline, you say so, with proof. That spine is the whole point of the role. This role is NOT for you if

- You want a script of test cases to execute. That work is automated now.
- You lead with certifications. We will test what you can actually do.
- Your bug reports say "it doesnt work" without steps, evidence, or severity.

- You soften findings because someone senior wants a green tick.
- You think AI output can be trusted because it sounds right.
- You need years on a resume to feel allowed to find a real defect.

Fresh graduates are welcome here, and are held to the same standard: evidence.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change.

Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Quality Analyst, Software and AI Systems (Mumbai)
🏢 Allerin Tech
📍 Mumbai