Experience:
6+ Years of Professional Machine Learning or AI Experience

Job Type
Contractor

Location:
Remote Required Profiles: LinkedIn profile required to apply Role Overview We are looking for experienced machine learning and AI professionals to develop, review, and validate terminal-based tasks used to evaluate AI agents. You’ll apply your expertise in model development, data processing, experimentation, and evaluation to create realistic and reproducible machine learning workflows. Key: Prior hands-on experience working on Terminal-Bench 3.0 projects is mandatory.

Key Responsibilities
• Design multi-step tasks based on realistic machine learning and AI workflows.
• Configure reproducible computational environments with pinned dependencies.
• Prepare datasets, model configurations, and evaluation inputs.
• Implement reference solutions and automated validation tests.
• Review model outputs, evaluation metrics, and numerical correctness.
• Debug dependency conflicts, execution failures, and computational issues.
• Improve task reliability, reproducibility, and evaluation quality.
• Document assumptions, limitations, and expected outputs. Key Requirements




• Bachelor's degree from a university ranked among the top 100 institutions in the country.
• Minimum 6 years of relevant machine learning, AI, or related professional experience.
• Prior hands-on experience with Terminal-Bench 3.0 projects.
• Relevant background in Machine Learning, AI, Computer Vision, NLP, Data Science, or Statistics.
• Practical experience implementing and validating computational workflows.
• Familiarity with automated testing and reproducible experimentation.
• Comfortable discussing technical workflows in an interview.
• Availability to work remotely on a flexible schedule. Preferred Technical Skills
• Python and machine learning frameworks.
• Model training, inference, data preprocessing, and evaluation.
• NLP, LLMs, computer vision, or applied AI.
• MLOps, experiment tracking, and dependency management.
• AI agent evaluation, benchmark development, or automated grading. Selection Process Step 1 – Short Screener Step 2 – AI Interview Step 3 – Paid Work Trial Step 4 – Project Onboarding

📌 Senior Software Engineer | $300/task (India)
🏢 Codefeast
📍 India