Skill: Experience in data annotation, AI quality evaluation, content moderation, or a related role is strongly preferred.

? Key Responsibilities
*High-level language proficiency (reading, writing, comprehension) in assigned language.
*Willingness to use primary personal Google account (for applicable roles).
*Full-time schedule flexibility supporting global 24-hour operations.
*Evaluate nuanced and ambiguous AI responses focusing on personalization quality.
*Design creative multi-turn starting prompts using personal context.
*Identify incorrect personalization, poor inferences, hallucinations, and grounding issues.
*Review Side-by-Side (SxS) model responses and detect subtle differences in naturalness.
*Write clear, structured rationales referencing specific conversation turns.
*Provide detailed annotations, feedback,



and collaboration in a remote setup.
*Maintain proper technical setup (Desktop/Laptop with stable internet)
? Required Skills
-Design and execute multi-turn conversational prompts (1–5 turns).
-Evaluate AI responses based on personalization intent and user context.
-Analyze responses for grounding issues and unsupported assumptions.
-Assess integration quality ensuring personal data is used naturally.
-Perform rigorous SxS model comparison and ranking.
-Write transparent and defensible evaluation rationales.
-Extract and verify debug information from model outputs.
-Maintain strict data hygiene by deleting evaluation conversations.

📌 Chinese Language Expert (India)
🏢 Giantmind Solutions
📍 India