athenaprep ResourcesOur StoryGuideBlogProfilePricing

HelpdeskGo to Dashboard

ResourcesOur StoryGuideBlogProfilePricingHelpdeskGo to Dashboard

All open roles

AIActively hiringPosted 3 months ago

AI Engineer — Retrieval & Evaluation

Make Ask Athena genuinely trustworthy. This is retrieval over our own question bank and a student's own notes — where a confidently wrong answer costs someone marks.

Apply for this role

Experience 2–5 yrs

Location Remote (India)

Arrangement Remote

Employment Full-time

Department AI

Responsibilities

• Improve retrieval quality and answer grounding across our content corpus
• Build evaluation harnesses so answer quality is measured, not argued about
• Cut hallucination rates and make refusals honest rather than evasive
• Keep inference fast and cost-sane at student scale
• Work with Content to turn subject expertise into better grounding data

Requirements

• 2+ years shipping ML or LLM features to real users
• Hands-on with embeddings, vector stores and retrieval pipelines
• Rigour about evaluation — you measure before and after, always




• Robust Python; comfortable in a TypeScript codebase

Preferred Skills

Nice to have, not required — apply even if none of these are true of you.

• Experience with Upstash Vector, pgvector or similar
• Background in education or assessment
• Published work, open-source contributions or writing on RAG

What success looks like

How we'll judge this role together — shared with you on day one, not at review time.

• Measurable reduction in ungrounded answers against a held-out eval set
• Median answer latency stays under two seconds
• Cost per assisted question trends down quarter over quarter

Growth path

• 1

First 90 days

Stand up the evaluation harness and establish the quality baseline.

• 2

Year one

Own the full AI surface — retrieval, grounding and cost.

• 3

Beyond

Define AI strategy as the product's intelligence layer deepens.

Skills you'll use

• Python
• RAG
• Vector search
• LL

📌 AI Engineer — Retrieval (Itanagar)
🏢 AthenaPrep
📍 Itanagar