Terminal-Bench 3.0 Expert – Senior Technical & Domain Specialist

Experience: 6–9+ Years, depending on domain

Job Type: Contractor

Compensation: Upto $300 per approved task

Domain: Coding | Machine Learning | Media | Systems | Security | Hardware | Operations/Finance | Science

Role Overview

We are looking for experienced Terminal-Bench 3.0 Experts to design, implement, test, and validate high-quality benchmark tasks across technical and scientific domains.

Prior hands-on experience working on Terminal-Bench 3.0 projects is highly preferred.

Key Responsibilities

- Design realistic, multi-step Terminal-Bench 3.0 tasks based on domain-specific workflows.
- Build reproducible, self-contained computational environments with pinned dependencies.
- Create datasets, configurations, simulations, parameters, or other task-specific inputs.
- Implement expert reference solutions using programming languages or domain-specific tools.
- Develop automated tests, graders, and validation criteria.

Universal Requirements

- Previous hands-on Terminal-Bench 3.0 experience – Preferred.
- Bachelor’s degree from a Top 100 institute/university in the country.
- Must meet the experience and educational requirements for at least one eligible domain.
- Strong analytical, technical, documentation, and problem-solving skills.
- Ability to independently handle task creation, implementation, testing, and validation.

Eligible Domains:

1. Coding – 8+ Years

Relevant roles: Senior/Staff/Principal Software Engineer, Backend/Frontend/Full-Stack Engineer, Compiler Engineer, Software Architect, Tech Lead, CTO.

Study: Computer Science; Computer Science & Engineering; Computer Engineering; Software Engineering; Systems Analysis; Systems & Computer Engineering; Informatics; Bioinformatics; Electronic Engineering; Robotics; Electrical & Computer Engineering; Software Systems; Systems Engineering; Computer Systems; Information Technology; Cloud Computing; Web Engineering; Computational Science; Computational Engineering.

2. Machine Learning – 8+ Years

Relevant roles: ML/AI Engineer, Applied Scientist, Research Scientist, NLP/LLM/CV Engineer, MLOps/ML Infrastructure Engineer.

Study:



Machine Learning; Artificial Intelligence; Computer Vision; Natural Language Processing; Data Science; Statistics & Data Science; Data Analytics; Robotics; Computer Science; Informatics; Deep Learning; Reinforcement Learning; Representation Learning; Transfer Learning; Meta-Learning; Self-Supervised Learning; Federated Learning; Active Learning; Multimodal Learning; Continual Learning; Statistical Learning Theory; Generative AI.

3. Media – 6+ Years

Relevant roles: Conductor, Composer, Session Musician, Music Instructor, Computational Linguist, NLP/Speech Engineer, Audio/DSP Engineer.

Study: Music; Music Composition & Production; Musicology; Orchestral Conducting; Classical Piano Performance; Music Education; Linguistics; Applied Linguistics; Computational Linguistics; English Literature; Advanced Vocal Studies; Music Technology; Sound / Audio Engineering; Phonetics; Graphic Design; Computer Graphics; Visual Communication; Typography; Digital Media Design; Visual Effects / Computer Animation.

4. Systems – 9+ Years

Relevant roles: SRE, Platform/Infrastructure Engineer, DevOps/Cloud Engineer, Kernel/Linux Engineer, Distributed Systems Engineer, Storage Engineer.

Study: Electrical Engineering

• Electrical &

- Computer Engineering
- Mechanical Engineering
- Electronic Engineering
- Aerospace Engineering
- Telecommunications Engineering
- Mechatronics
- Electromagnetics
- Chemical Engineering
- Information Systems
- Systems Engineering
- Industrial &
- Systems Engineering
- Computer Science
- Computer Engineering
- Control Systems Engineering
- High Performance Computing
- Aerospace Engineering
- Computer Systems
- Software Engineering
- Computer Networks
- Distributed Systems
- Operating Systems
- Information Technology
- Computer Science &
- Engineering

5. Security – 8+ Years

Relevant roles: Security/AppSec Engineer, Penetration Tester, Red/Blue Team Specialist, Threat Intelligence Specialist, Reverse Engineer, DevSecOps Engineer, CISO/Director of Security.

Study: Cybersecurity

• Cybersecurity &

- Information Assurance
- Information Security
- Computer Security
- Cloud Security
- Cryptography &
- Data Security
- Digital Forensics
- Computer Science
- Law – Cybersecurity
- Cyber Operations
- Ethical Hacking
- Offensive Security
- Penetration Testing
- Cyber Warfare &
- Defense
- Application Security
- Software Security
- Secure Software Engineering




- Hardware Security
- Embedded Systems Security
- IoT Security
- Critical Infrastructure &
- SCADA/ICS Security
- Network Security

6. Hardware – 9+ Years

Relevant roles: Electrical/Embedded/Firmware Engineer, FPGA/ASIC/RTL Engineer, Verification Engineer, RF/DSP Engineer, Avionics Engineer.

Study:Electrical Engineering

• Electrical &

- Computer Engineering
- Mechanical Engineering
- Electronic Engineering
- Aerospace Engineering
- Telecommunications Engineering
- Mechatronics
- Electromagnetics
- Chemical Engineering
- Information Systems
- Systems Engineering
- Industrial &
- Systems Engineering
- Computer Science
- Computer Engineering
- Control Systems Engineering
- High Performance Computing
- Aerospace Engineering
- Computer Systems
- Robotics
- Physics
- Materials Science
- Microelectronics
- VLSI Design
- Power Electronics
- Mechanical Design
- Computer Architecture
- Embedded Systems
- Optical Engineering
- Semiconductor Engineering
- Manufacturing Engineering

7. Operations / Finance – 9+ Years

Relevant roles: Quantitative Analyst/Researcher, Risk Analyst, Actuary, FP&A; Manager, Financial Controller, Investment Director.

Study: Business Administration; Economics; Economics & Statistics; Econometrics & Mathematical Economics; Finance; Quantitative Finance; Qualified Accounting; Management; Marketing; Transport & Logistics; Compliance; Health Economics; Public Policy; Actuarial Science; Financial Engineering; Accounting & Finance; Medicine (Claims); Supply Chain Management; Operations Research; Industrial Engineering

8. Science – PhD Required / In Progress Accepted

Experience: 7-10+ years relevant experience OR 3+ years relevant experience plus at least 3 publication in a Scopus-indexed journal.

Relevant roles: Research Scientist, Postdoctoral Researcher, Professor/Lecturer, Computational Biologist, Materials Scientist, Biostatistician, Clinical/Medical Scientist.

Study: Physics, Chemistry, Biology, Mathematics, Statistics, Neuroscience, Medicine, Materials Science, and related fields.

Preferred Skills

- Experience evaluating AI coding agents or terminal agents.
- Experience creating benchmark tasks, automated graders, or evaluation pipelines.
- Research Software Engineering experience.
- Publications or open-source contributions involving computational science.
- Experience converting research or experimental workflows into reproducible computational packages.

📌 AI Evaluation Expert(Terminal Bench 3.0) | Upto $300/task (India)
🏢 Codefeast
📍 India