Experience: 7+ Years of Skilled Systems or Infrastructure Experience

Job Type: Contractor

Location: Remote

Required Profiles: LinkedIn profile required to apply

Role Overview

We are looking for experienced systems and infrastructure engineers to develop and review terminal-based tasks that evaluate AI agents' ability to troubleshoot, configure, and optimize complex computing environments. You’ll contribute your knowledge of Linux, infrastructure, networking, and distributed systems to improve benchmark reliability and realism.

Important: Prior hands-on experience working on Terminal-Bench 3.0 projects is mandatory.

Key Responsibilities

- Design multi-step terminal tasks based on realistic systems engineering workflows.
- Build reproducible environments with pinned dependencies and defined configurations.
- Develop and validate tasks involving Linux, networking, infrastructure, and distributed systems.
- Implement reference solutions and automated system validation tests.
- Troubleshoot service failures, permissions, networking, and configuration issues.
- Assess system behavior, reliability, and performance under defined conditions.
- Improve evaluation criteria and task reproducibility.




- Document technical assumptions and expected system behavior.

Key Requirements

- Bachelor's degree from a university ranked among the top 100 institutions in the country.
- Minimum 7 years of relevant systems or infrastructure experience.
- Prior hands-on experience with Terminal-Bench 3.0 projects.
- Relevant background in Computer Science, Electrical/Computer Engineering, Systems Engineering, or Control Systems.
- Strong knowledge of Linux, command-line tools, and system troubleshooting.
- Experience validating technical environments and automated workflows.
- Comfortable discussing troubleshooting approaches in an interview.
- Availability to work remotely on a flexible schedule.

Preferred Technical Skills

- Linux administration and shell scripting.
- Cloud infrastructure, DevOps, and platform engineering.
- Networking, distributed systems, and storage.
- Containerization, CI/CD, and infrastructure automation.
- Systems benchmarking and automated evaluation.

Selection Process Step 1 – Short Screener

Step 2 – AI Interview

Step 3 – Paid Work Trial

Step 4 – Project Onboarding

📌 Systems Experts | $300/task (India)
🏢 Codefeast
📍 India