About Patronus AI

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.

We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.

At Patronus AI we are looking for experienced software engineers (task based contract) to design realistic, challenging tasks for frontier AI models and to judge how well those models handle them. You'll apply your day-to-day engineering judgment to show where AI gets code, reasoning and technical instructions right, and where it falls short.

What you'll do

- Design realistic, multi-step coding and technical tasks that test an AI model's ability to reason, write code and follow precise instructions.
- Build tasks around realistic workspace materials such as codebases, technical specs, architecture docs and datasets.
- Evaluate AI-generated code and technical content for correctness, efficiency, clarity and alignment with real-world engineering practice.
- Grade model outputs against rubrics and ground-truth answers, and write clear, structured feedback.
- Help improve how AI understands programming, system design, data workflows and engineering best practices.
- Work independently and asynchronously, meet deadlines,



and collaborate with the Patronus team to keep quality high.

What we're looking for

- 2+ years of professional experience in software engineering, data science or analytics (internships excluded).
- Strong coding skills in at least one major language, such as Python, Java, C++, JavaScript, TypeScript or Go.
- Experience building, reviewing and debugging production-grade code.
- Ability to follow detailed technical guidelines and work independently.
- Excellent written communication and close attention to detail.
- A bachelor's degree in computer science, engineering or a related field, or equivalent experience.
- Experience with system design, data pipelines, ML or LLM-based applications.
- Prior work in code review, technical writing, AI training or model evaluation.

Our Standards

- All tasks and solutions must be human-authored. LLM-generated content is not permitted.
- Tasks must be original and non-searchable.

How to apply

1. Fill out the application form.
2. Upload your resume and share links to your GitHub, LinkedIn or portfolio.
3. Shortlisted candidates complete a short AI Interview.
4. Successful candidates are onboarded and can start working on tasks.

Pay: $50–$100 per hour and some tasks would have a flat rate

Location: Remote (India)

Type: Hourly, project/task-based contract (not a full-time role)

Commitment: Versatile, typically 15–20 hours per week; can be done alongside a full-time job

Applications are reviewed on a rolling basis. Placement depends on project needs and assessment results.

📌 Software Engineer – AI Evaluation Expert (Contractual) (India)
🏢 Patronus AI
📍 India