05 Nov
|
Be Additive
|
India
Role Overview
We are looking for an analytical, detail-oriented AI Data Analyst to evaluate, benchmark, and fine-tune next-generation Large Language Models (LLMs) such as GPT. In this role, you will leverage strong analytical reasoning and high-level English comprehension to train AI systems on complex problem-solving, fact-checking, and nuanced logic.
You will read, summarize, and deconstruct large bodies of information into clear logical blocks, conduct independent web research to fact-check model assertions, and guide models through intricate analytical puzzles. Working directly on frontier AI training projects will provide hands-on experience with how AI generates decisions, positioning you ahead of the curve in an AI-first career landscape.
Job Requirements:
- English Comprehension & Writing: High-order reading comprehension and native or bilingual written English skills, capable of explaining complex, nuanced reasoning plainly and unambiguously.
- Analytical & Critical Thinking: Strong deductive reasoning and lateral thinking abilities, with the discipline to systematically break down multi-variable problems.
- Research Rigor: Proficiency in rapid, reliable online research to cross-reference claims, locate primary data, and verify empirical evidence.
- Constructive Feedback & Annotation: Ability to write precise, actionable critique notes, tag errors according to rubrics, and explain logical flaws systematically.
- Independence & Remote Readiness:
Self-directed work ethic with the ability to maintain consistent productivity and accuracy in an asynchronous, work from home environment.
- Technical Setup: Dedicated personal desktop or laptop running updated software with a stable, high-speed internet connection.
Job Responsibilities:
- Scenario & Task Authoring: Create, solve, and annotate a variety of analytical challenges, logic problems, and realistic decision scenarios to train models on sound methodology.
- Gold-Standard Solution Generation: Formulate step-by-step rationales, logical proofs, and clear explanations that illustrate not just the correct answer, but the underlying reasoning required to reach it.
- Fact-Checking & Source Verification: Research external sources to validate claims, assess numerical accuracy, and catch hallucinations or flawed assumptions in model outputs.
- Error Analysis & Annotation: Deconstruct incorrect or suboptimal AI responses, providing detailed rubrics, corrections, and constructive feedback to drive model improvement.
Education & Experience
- Bachelor or higher degree from relevant engineering domain is a must for this position.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is a plus.
Offer Details:
- Commitments Required: Upto 40 hours per week with 4 hours of overlap with PST.
- Engagement type: Contractor
- Engagement Length: Up to 1 week
Evaluation Process:
- Candidates will be required to submit a Job Interest Form & assessment.
- Talents finalized in the assessment will be invited for onboarding.
📌 BA Generalist (India)
🏢 Be Additive
📍 India