DESCRIPTION:
Key job responsibilities

1. AI Data Annotation, Quality Auditing & Model Improvement
- Perform multi-domain data annotation and golden dataset curation for AI model improvement, following established SOPs and quality benchmarks
- Validate and audit LLM judge outputs through human-in-the-loop review; use AI tools to flag patterns and anomalies
- Maintain annotation accuracy and audit throughput targets; use AI-assisted error analysis to identify systematic failures and escalate to Process Experts
- Participate in calibration exercises to ensure reviewer consistency and draft audit reports for program leads

2. Red Teaming Execution
- Execute adversarial testing across multiple Alexa experiences (Alexa+, Ring, Automotive, Kids), using AI to generate diverse attack vectors and edge cases
- Identify, document, and categorize policy violations, safety gaps, and vulnerabilities by severity and impact
- Draft red teaming documentation and vulnerability summaries, ensuring findings are clearly categorized for program leads

3. Customer Feedback Triage & Analysis




- Classify and triage daily customer feedback records per SOPs, using AI to pre-sort and surface emerging patterns
- Identify recurring issues, escalation-worthy trends, and edge cases in customer interaction data
- Handle complex cases requiring human judgment alongside AI-automated pre-filtering and routing
- Generate trend summaries and insight reports for program leads

4. Incident Monitoring & Escalation Support
- Monitor for policy violations and emerging issues per established protocols, using AI to track incident patterns across workstreams
- Draft escalation tickets, incident summaries, and root-cause hypotheses to support cross-functional response
- Coordinate with Operations, Engineering, and Science teams to drive timely resolution; escalate complex cases.
- Contribute observations and incident learnings to refine SOPs, tools, and response playbooks

5. Process Improvement & Team Support
-

📌 Content Risk Analyst, Asci (Bengaluru)
🏢 ADCI - BLR 14 SEZ
📍 Bengaluru