About Touchstones
Touchstones is an AI-native hiring company. We build role-specific engineering work samples where candidates are allowed to use AI. We capture the work trail and map every piece of evidence to the hiring team's rubric, and a human reviewer makes the call. We've run 850+ candidate screens, growing 145% month over month, and we're backed by Mucker Capital. You'd be one of the first engineers, working directly with the founder.
Location: Remote (India). Full-time, Mid-Senior level.
What you'll do
- Build the LLM pipelines that evaluate captured work against each rubric criterion, with evidence citations and calibrated reasoning.
- Design evaluation harnesses (golden sets, regression evals, recall/precision on evidence retrieval) so scoring quality is measured, not assumed.
- Author and harden AI-engineering assessments: retrieval evaluation, agent tool-call guardrails, prompt-injection defenses.
- Ship agentic features for reviewers: summarizing work trails, flagging gaps, drafting follow-up interview questions.
- Own model choice, cost, latency and fallback across providers.
- Keep the product's principles intact: AI advises,
humans decide, no biometric signals.
Requirements
- 5+ years in software engineering, including 2+ years shipping LLM-powered features to production.
- Robust Python and/or TypeScript; experience with LLM APIs, structured outputs, tool calling and RAG.
- Hands-on experience building evals and judging model quality with data.
- A product mindset and comfort with startup ambiguity.
- Clear written communication; able to overlap with US Pacific mornings.
Nice to have
- Experience with hiring/HR tech, assessment design or psychometrics.
- Background in agent safety, guardrails or red-teaming.
- Postgres/Supabase or Next.js experience.
- Open-source or public writing on AI evaluation.
Compensation
- India: competitive, up to 55 LPA (higher for exceptional fit), plus early-employee equity.
How to apply Email
[email protected] with the subject "Senior AI Engineer [Your Name]". Include your resume or LinkedIn and a link to something you built with LLMs, or apply on LinkedIn.
📌 Senior AI Engineer (India)
🏢 Touchstones
📍 India