15 Aug
|
Sourcebae
|
India
?️ Hiring: Domain Expert – History
Experience:
3–6 Years
Work Mode:
Remote
? Work Shift
7:30 PM – 12:30 AM IST
*Remaining 4 hours are flexible.*
About the Role
We are looking for a highly qualified
History Domain Expert
to help evaluate and improve
Large Language Models (LLMs)
.
You will leverage your expertise across
Ancient, Medieval, Contemporary, Political, Military History, Archaeology, and Historiography
to create challenging evaluations, assess AI-generated responses, identify knowledge gaps, and provide evidence-based feedback.
? Key Responsibilities
- Create advanced, domain-specific prompts covering diverse areas of History.
- Evaluate AI-generated responses for
factual accuracy, reasoning, completeness, and nuance
.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Compare and rank multiple AI-generated responses.
- Provide evidence-based feedback using reliable and authoritative references.
- Identify ambiguous questions and propose improved prompts.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and clear documentation.
? Minimum Qualifications
- Master’s degree or higher
in History or a closely related discipline.
- 3+ years
of professional, research, or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.
- Ability to work independently and provide objective, evidence-backed reviews.
⭐ Preferred Qualifications
- Experience with
LLMs, Generative AI, Prompt Engineering, or AI Evaluation
.
- Published research, industry recognition, or teaching experience is a plus.
- Strong research and source-validation skills.
📌 History Specialist (India)
🏢 Sourcebae
📍 India