17 Sep
|
Hire Feed
|
Mumbai
Job Description Role : Quality Analyst (Remote) Location : Remote (Work from Anywhere) Role Overview: We are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content. Key Responsibilities: • Evaluate the quality of personalized responses from an AI model using your own personal experiences as context. • Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately. • Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
• Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy. • Provide detailed feedback on model behavior to improve personalization performance. Required Skills & Qualifications: • English proficiency with a high degree of competence in reading and writing. • Experience in prompt engineering or designing test cases for AI models. • Ability to analyze nuanced and ambiguous AI responses with analytical rigor. • Familiarity with personalization concepts and evaluation metrics in AI systems. • Attention to detail to identify subtle discrepancies in model outputs. • Willingness to use your primary personal Google
📌 Quality Analyst (Mumbai)
🏢 Hire Feed
📍 Mumbai