ResourcesOur StoryGuideBlogProfilePricing

HelpdeskStart Free

All open roles

AIActively hiringPosted 5 weeks ago

AI Engineer — Retrieval & Evaluation

Make Ask Athena genuinely trustworthy. This is retrieval over our own question bank and a student's own notes — where a confidently wrong answer costs someone marks.

Apply for this role

Experience 2–5 yrs

Location Remote (India)

Arrangement Remote

Employment Full-time

Department AI

Responsibilities

Improve retrieval quality and answer grounding across our content corpus
Build evaluation harnesses so answer quality is measured, not argued about
Cut hallucination rates and make refusals honest rather than evasive
Keep inference fast and cost-sane at student scale
Work with Content to turn subject expertise into better grounding data

Requirements

2+ years shipping ML or LLM features to real users
Hands-on with embeddings, vector stores and retrieval pipelines
Rigour about evaluation — you measure before and after, always
Strong Python; comfortable in a TypeScript codebase

Preferred Skills

Nice to have,



not required — apply even if none of these are true of you.

Experience with Upstash Vector, pgvector or similar
Background in education or assessment
Published work, open-source contributions or writing on RAG

What success looks like

How we'll judge this role together — shared with you on day one, not at review time.

Measurable reduction in ungrounded answers against a held-out eval set
Median answer latency stays under two seconds
Cost per assisted question trends down quarter over quarter

Growth path

1

First 90 days

Stand up the evaluation harness and establish the quality baseline.

2

Year one

Own the full AI surface — retrieval, grounding and cost.

3

Beyond

Define AI strategy as the product's intelligence layer deepens.

Skills you'll use

Python
RAG
Vector search
LLM evaluation
Prompt engineering

Perks

Remote-first

Work from anywhere in India, with hours you actually control.

Meaning

📌 AI Engineer — Retrieval (Itanagar)
🏢 AthenaPrep
📍 Itanagar