Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work, and advanced STEM reasoning. In software engineering, Turing is the largest and longest-running data provider in the category. Turing also works with Fortune 500 enterprises across financial services, life sciences, healthcare, retail, automotive, and CPG to build and deploy end-to-end agentic AI systems inside mission-critical workflows. By operating on both sides, Turing closes the loop between frontier research and enterprise deployment, turning real-world deployment signals into better data, evaluations, and more capable models. Senior Software Engineer, AI Evaluation Infrastructure

We build the infrastructure that frontier AI labs use to evaluate coding agents and language models: benchmark datasets, agent evaluation runs at scale, and automated task quality checks. You would own features across the stack, from the data model and background jobs to the screens our users work in every day.

This is a role for an experienced engineer who works independently, makes sound tradeoffs, and turns a loosely defined request into something shipped, tested, and safe to leave alone.

Design and ship features end to end: data model, API, background workers, and the UI when the change needs it.

Improve how benchmark tasks are quality-checked: verifiers, rubric-based and LLM-as-a-judge grading, and deciding whether a task is clear, solvable, and fair to score.





Review teammates’ pull requests against our engineering guidelines and help keep the codebase consistent.

Typically 5+ years building and operating production backend systems, with ownership of at least one service from design through on-call.

Strong Python. Experience with Django (or a similar framework), PostgreSQL, and a task queue such as Celery. Hands-on experience in LLM evaluation, beyond calling a model API. Experience with Harbor, Terminal-Bench, SWE-bench, Inspect, or a similar harness is a solid plus.

Judgment about task quality. Comfort with a TypeScript and React frontend when a change is visible there. You don’t need to be a frontend specialist.

Clear writing. Experience running agents in sandboxed or containerized environments (Docker, Kubernetes, or cloud sandboxes such as Modal or Daytona).

Experience with LLM-as-a-judge or rubric-based grading, and with reducing judge bias and noise.

Familiarity with coding agents such as Claude Code, Codex, or OpenHands, and with MCP.

Experience with distributed job scheduling, concurrency limits, or database locking at scale.

Contributions to open-source evaluation or infrastructure projects.

Written engineering guidelines, applied consistently,



with the same review bar for everyone.

Business logic lives in services. We work at Start-Up Speed: We move fast, stay agile and favor action because momentum is the foundation of perfection

We are AI forward: We help our clients build the future of Al and implement it in our own roles and workflow to amplify productivity.

Work at the frontier of AI , helping the world’s leading AI labs improve their most advanced models by building expert datasets, RL environments, and first-of-a-kind benchmarks.

Contribute to leading-edge AI research and showcase your work at top conferences such as ICLR, ICML, and NeurIPS.

Bring frontier AI innovation to the enterprise , applying lessons learned from leading AI labs to solve real-world business challenges.

Collaborate with and learn from exceptional colleagues with deep AI experience from Google, Meta, Amazon, and other leading technology companies.

Move at the pace of AI innovation , with the speed, ownership, and impact of a startup.

We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability, protected veteran status, or any other legally protected characteristics. At Turing we are dedicated to building a diverse, inclusive and authentic workplace and celebrate authenticity, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways.

📌 Senior Software Development Engineer - Services (India)
🏢 Turing
📍 India