About Touchstones Touchstones is an AI-native hiring company. We build role-specific engineering work samples where candidates are allowed to use AI. We capture the work trail and map every piece of evidence to the hiring team's rubric, and a human reviewer makes the call. We've run 850+ candidate screens, growing 145% month over month, and we're backed by Mucker Capital. You'd be one of the first engineers, working directly with the founder.
Location:
Remote (India). Full-time, Mid-Senior level.
What you'll do
• Build the LLM pipelines that evaluate captured work against each rubric criterion, with evidence citations and calibrated reasoning.
• Design evaluation harnesses (golden sets, regression evals, recall/precision on evidence retrieval) so scoring quality is measured, not assumed.
• Author and harden AI-engineering assessments: retrieval evaluation, agent tool-call guardrails, prompt-injection defenses.
• Ship agentic features for reviewers: summarizing work trails, flagging gaps, drafting follow-up interview questions.
• Own model choice, cost, latency and fallback across providers.
• Keep the product's principles intact: AI advises,
humans decide, no biometric signals. Requirements
• 5+ years in software engineering, including 2+ years shipping LLM-powered features to production.
• Strong Python and/or TypeScript; experience with LLM APIs, structured outputs, tool calling and RAG.
• Hands-on experience building evals and judging model quality with data.
• A product mindset and comfort with startup ambiguity.
• Explicit written communication; able to overlap with US Pacific mornings. Nice to have
• Experience with hiring/HR tech, assessment design or psychometrics.
• Background in agent safety, guardrails or red-teaming.
• Postgres/Supabase or Next.js experience.
• Open-source or public writing on AI evaluation. Compensation
• India: competitive, up to 55 LPA (higher for exceptional fit), plus early-employee equity.
How to apply
Email
[email protected] with the subject "Senior AI Engineer [Your Name]". Include your resume or LinkedIn and a link to something you built with LLMs, or apply on LinkedIn.
📌 Senior AI Engineer (India)
🏢 Touchstones
📍 India