Terminal-Bench 3.0 Expert – Senior Technical & Domain Specialist

Experience:
6–9+ Years, depending on domain

Job Type
Contractor Compensation: Upto $300 per approved task Domain: Coding | Machine Learning | Media | Systems | Security | Hardware | Operations/Finance | Science Role Overview We are looking for experienced Terminal-Bench 3.0 Experts to design, implement, test, and validate high-quality benchmark tasks across technical and scientific domains. Prior hands-on experience working on Terminal-Bench 3.0 projects is highly preferred.

Key Responsibilities
• Design realistic, multi-step Terminal-Bench 3.0 tasks based on domain-specific workflows.
• Build reproducible, self-contained computational environments with pinned dependencies.
• Create datasets, configurations, simulations, parameters, or other task-specific inputs.
• Implement expert reference solutions using programming languages or domain-specific tools.
• Develop automated tests, graders, and validation criteria. Universal Requirements
• Previous hands-on Terminal-Bench 3.0 experience – Preferred.
• Bachelor’s degree from a Top 100 institute/university in the country.
• Must meet the experience and educational requirements for at least one eligible domain.
• Strong analytical, technical, documentation, and problem-solving skills.
• Ability to independently handle task creation, implementation, testing, and validation. Eligible Domains: 1. Coding – 8+ Years Relevant roles: Senior/Staff/Principal Software Engineer, Backend/Frontend/Full-Stack Engineer, Compiler Engineer, Software Architect, Tech Lead, CTO. Study: Computer Science; Computer Science & Engineering; Computer Engineering; Software Engineering; Systems Analysis; Systems & Computer Engineering; Informatics; Bioinformatics; Electronic Engineering; Robotics; Electrical & Computer Engineering; Software Systems; Systems Engineering; Computer Systems; Information Technology; Cloud Computing; Web Engineering; Computational Science; Computational Engineering. 2. Machine Learning – 8+ Years Relevant roles: ML/AI Engineer, Applied Scientist, Research Scientist, NLP/LLM/CV Engineer, MLOps/ML Infrastructure Engineer. Study:



Machine Learning; Artificial Intelligence; Computer Vision; Natural Language Processing; Data Science; Statistics & Data Science; Data Analytics; Robotics; Computer Science; Informatics; Deep Learning; Reinforcement Learning; Representation Learning; Transfer Learning; Meta-Learning; Self-Supervised Learning; Federated Learning; Active Learning; Multimodal Learning; Continual Learning; Statistical Learning Theory; Generative AI. 3. Media – 6+ Years Relevant roles: Conductor, Composer, Session Musician, Music Instructor, Computational Linguist, NLP/Speech Engineer, Audio/DSP Engineer. Study: Music; Music Composition & Production; Musicology; Orchestral Conducting; Classical Piano Performance; Music Education; Linguistics; Applied Linguistics; Computational Linguistics; English Literature; Advanced Vocal Studies; Music Technology; Sound / Audio Engineering; Phonetics; Graphic Design; Computer Graphics; Visual Communication; Typography; Digital Media Design; Visual Effects / Computer Animation. 4. Systems – 9+ Years Relevant roles: SRE, Platform/Infrastructure Engineer, DevOps/Cloud Engineer, Kernel/Linux Engineer, Distributed Systems Engineer, Storage Engineer. Study: Electrical Engineering; Electrical & Computer Engineering; Mechanical Engineering; Electronic Engineering; Aerospace Engineering; Telecommunications Engineering; Mechatronics; Electromagnetics; Chemical Engineering; Information Systems; Systems Engineering; Industrial & Systems Engineering; Computer Science; Computer Engineering; Control Systems Engineering; High Performance Computing; Aerospace Engineering; Computer Systems; Software Engineering; Computer Networks; Distributed Systems; Operating Systems; Information Technology; Computer Science & Engineering 5. Security – 8+ Years Relevant roles: Security/AppSec Engineer, Penetration Tester, Red/Blue Team Specialist, Threat Intelligence Specialist, Reverse Engineer, DevSecOps Engineer, CISO/Director of Security. Study:



Cybersecurity; Cybersecurity & Information Assurance; Information Security; Computer Security; Cloud Security; Cryptography & Data Security; Digital Forensics; Computer Science; Law – Cybersecurity; Cyber Operations; Ethical Hacking; Offensive Security; Penetration Testing; Cyber Warfare & Defense; Application Security; Software Security; Secure Software Engineering; Hardware Security; Embedded Systems Security; IoT Security; Critical Infrastructure & SCADA/ICS Security; Network Security 6. Hardware – 9+ Years Relevant roles: Electrical/Embedded/Firmware Engineer, FPGA/ASIC/RTL Engineer, Verification Engineer, RF/DSP Engineer, Avionics Engineer. Study:Electrical Engineering; Electrical & Computer Engineering; Mechanical Engineering; Electronic Engineering; Aerospace Engineering; Telecommunications Engineering; Mechatronics; Electromagnetics; Chemical Engineering; Information Systems; Systems Engineering; Industrial & Systems Engineering; Computer Science; Computer Engineering; Control Systems Engineering; High Performance Computing; Aerospace Engineering; Computer Systems; Robotics; Physics; Materials Science; Microelectronics; VLSI Design; Power Electronics; Mechanical Design; Computer Architecture; Embedded Systems; Optical Engineering; Semiconductor Engineering; Manufacturing Engineering 7. Operations / Finance – 9+ Years Relevant roles: Quantitative Analyst/Researcher, Risk Analyst, Actuary, FP&A; Manager, Financial Controller, Investment Director. Study: Business Administration; Economics; Economics & Statistics; Econometrics & Mathematical Economics; Finance; Quantitative Finance; Skilled Accounting; Management; Marketing; Transport & Logistics; Compliance; Health Economics; Public Policy; Actuarial Science; Financial Engineering; Accounting & Finance; Medicine (Claims); Supply Chain Management; Operations Research; Industrial Engineering 8. Science – PhD Required / In Progress Accepted

Experience:
7-10+ years relevant experience OR 3+ years relevant experience plus at least 3 publication in a Scopus-indexed journal. Relevant roles: Research Scientist, Postdoctoral Researcher, Professor/Lecturer, Computational Biologist, Materials Scientist, Biostatistician, Clinical/Medical Scientist. Study: Physics, Chemistry, Biology, Mathematics, Statistics, Neuroscience, Medicine, Materials Science, and related fields. Preferred Skills
• Experience evaluating AI coding agents or terminal agents.
• Experience creating benchmark tasks, automated graders, or evaluation pipelines.
• Research Software Engineering experience.
• Publications or open-source contributions involving computational science.
• Experience converting research or experimental workflows into reproducible computational packages.

📌 Terminal Bench 3.0 Expert | Upto $300/task (India)
🏢 Codefeast
📍 India