06 Sep
|
AI Data Innovations
|
India
06 Sep
AI Data Innovations
India
Technical Data Annotator – AI Safety & Guardrails
Location: Remote
Project duration: Approximately 12 weeks
Compensation: $6.50 USD per hour
Employment type: Independent contractor / project-based
Hours: To be confirmed
About the Role
We are seeking technically literate data annotators to support an AI safety project focused on improving the guardrail systems of an enterprise coding assistant.
In this role, you will review and annotate multi-turn conversations between users and an AI coding assistant. These conversations may contain natural language, source code, command-line instructions, configuration files, system logs, and other technical content.
Your primary responsibility will be to identify potential safety risks related to content moderation and prompt injection while considering the context and intent of each interaction.
We will provide project-specific guidelines and training.
Key Responsibilities
Review multi-turn, code-related conversations involving user requests and AI-generated responses.
Interpret code snippets, code changes, system logs,
command-line instructions, and structured tool outputs.
Identify and label potential prompt-injection attempts, such as instructions intended to override system rules or hidden malicious content.
Identify content-moderation risks, including hateful, harmful, or illicit content.
Evaluate the context and intent of technical language rather than relying only on individual keywords. For example, terms such as “kill a process” or “execute a payload” may be legitimate in a programming context.
Replace masked or redacted placeholders with realistic, neutral synthetic information when required.
Follow detailed annotation guidelines and apply multi-level taxonomies consistently.
Participate in regular calibration sessions and meet established quality and accuracy standards.
Escalate unclear or ambiguous cases according to project procedures.
Required Qualifications
Bachelor’s degree in Computer Science, Software Engine
📌 Technical Data Annotator (India)
🏢 AI Data Innovations
📍 India