Design and execute linguistic test cases to validate Quick's natural language features across diverse inputs, edge cases, and user scenarios.
Evaluate model outputs for accuracy, fluency, and relevance by applying linguistic expertise to identify regressions, hallucinations, and quality gaps.
Develop and maintain testing guidelines and rubrics that ensure consistent, repeatable evaluation standards across annotators and test cycles.
Analyze test results and report findings using Python and SQL to surface patterns, quantify defect rates, and prioritize issues for engineering teams.
Collaborate with engineers, scientists, and PMs to define acceptance criteria, triage language-related bugs, and validate fixes before releases
Work on high complex annotations and audits as needed
Work effectively both independently and as part of a team
Uphold a high bar for quality while delivering accurate work at pace
Apply solid attention to detail and Critically assess data quality
Manage competing tasks and adapt quickly to shifting priorities
Take ownership and Exercise sound judgment in escalating
Handle highly complex tasks and Scale with growing workloads
About the team
Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
About AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our
📌 ML Data Associate III, AWS Quick (Chennai)
🏢 Amazon
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.