Experience: 6+ Years of Relevant Professional Media, Music, Linguistics, or Audio Experience

Job Type: Contractor

Location: Remote

Required Profiles: LinkedIn profile required to apply

Role Overview

We are looking for experienced professionals in music, audio processing, speech technology, and computational linguistics to develop and review terminal-based tasks for AI agent evaluation. You’ll use your domain expertise to create realistic workflows, validate outputs, and ensure that tasks reflect practical professional or research activities.

Important: Prior hands-on experience working on Terminal-Bench 3.0 projects is mandatory.

Key Responsibilities

- Design multi-step tasks based on realistic media, music, speech, or linguistic workflows.
- Prepare input datasets, audio samples, linguistic data, and processing configurations.
- Configure reproducible computational environments and relevant domain-specific tools.
- Implement reference solutions and objective validation tests.
- Review output accuracy, file formats, and domain-specific correctness.
- Debug processing failures, dependencies, and numerical issues.
- Improve task reliability, reproducibility, and evaluation criteria.




- Document assumptions and technical decisions for reviewers.

Key Requirements

- Bachelor's degree from a university ranked among the top 100 institutions in the country.
- Minimum 6 years of relevant professional experience.
- Prior hands-on experience with Terminal-Bench 3.0 projects.
- Relevant background in Music, Linguistics, Computational Linguistics, or English Literature.
- Practical expertise in at least one relevant media or language specialization.
- Ability to translate domain workflows into testable tasks.
- Comfortable discussing technical or domain-specific workflows in an interview.
- Availability to work remotely on a versatile schedule.

Preferred Technical Skills

- Audio processing and digital signal processing.
- Speech technology, NLP, and computational linguistics.
- Music composition, performance, or conducting workflows.
- Scripting and command-line tools relevant to the specialization.
- Automated evaluation, benchmark development, or reproducible research.

Selection Process Step 1 – Short Screener

Step 2 – AI Interview

Step 3 – Paid Work Trial

Step 4 – Project Onboarding

📌 Media Experts | $300/task (India)
🏢 Codefeast
📍 India