12 Oct
|
Evaratus (Formerly Scaler AI Labs)
|
Bengaluru
12 Oct
Evaratus (Formerly Scaler AI Labs)
Bengaluru
About Scaler AI Labs
Scaler AI Labs is Scaler’s frontier AI research and engineering division. We build Reinforcement Learning (RL) environments for the world’s leading AI research companies.
We ship rapid, maintain high quality bars, and work directly with world-class AI researchers. If you want to work at the intersection of product, engineering, and frontier AI, this is the team.
Role Overview
As a Manual QA Engineer, you will be responsible for validating RL environments before they are shipped to clients. You’ll work closely with developers and product teams to identify bugs, test workflows, validate task graders, and ensure environments meet the required quality bar.
What You’ll Do
Setting QA
• Test web applications, UI flows, workflows, and edge cases.
• Create and execute test cases based on product requirements.
• Perform functional, regression, exploratory, and negative testing.
• Identify and document bugs with clear reproduction steps and expected vs. actual behaviour.
• Re-test fixes and run regression checks before release.
• Identify gaps in requirements and test coverage.
• Sign off on environments that meet the quality bar.
Task & Grader Testing
• Test task prompts for clarity, accuracy, and completeness.
• Verify that tasks can be completed as intended.
• Test graders for correct pass/fail evaluation.
• Identify grader bugs, edge cases, false positives, and false negatives.
• Validate that the final environment state matches the expected task outcome.
QA Process
• Maintain test cases, test plans, and regression checklists.
• Participate in requirement and feature discussions from a QA perspective.
• Prioritize bugs based on severity and impact.
• Work closely with developers to investigate and resolve issues.
• Manage multiple QA cycles and releases in parallel.
What We’re Looking For
Must Have
• 1–3 years of experience in Manual QA / Software Testing.
• Experience testing web applications or SaaS products.
• Strong understanding of functi
📌 Quality Assurance Engineer (Bengaluru)
🏢 Evaratus (Formerly Scaler AI Labs)
📍 Bengaluru