This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project based in India.

This remote freelance role offers experienced technical specialists the opportunity to help improve the quality and reliability of AI training and evaluation systems. You will audit developer workflow tasks to ensure they are technically accurate, realistic, reproducible, and supported by reliable tests and evaluation criteria. The work focuses on modern developer tooling and AI-assisted coding workflows, including coding assistants, telemetry and trace analysis, and developer workflow ecosystems. You will identify technical issues, integration faults, inefficiencies, and logic errors within complex tasks. Your feedback will directly contribute to making AI training workflows more rigorous and useful for real-world development environments.



The role is designed for specialists who can apply deep technical expertise and strong analytical judgment to evaluate AI-focused developer scenarios.

n

Accountabilities:

• Evaluate developer workflow tasks for technical accuracy, realism, solvability, reproducibility, and completeness.

• Assess whether tasks are supported by reliable tests and appropriate evaluation criteria.

• Audit AI-assisted developer workflows and identify issues that could affect the quality or validity of training and evaluation tasks.

• Review IDE integrations and identify technical faults, inconsistencies, or workflow issues.

• Analyze AI-assisted coding processes and identify inefficiencies, logic errors, or technical shortcomings.

• Test and troubleshoot complex technical scenarios to determine whether tasks function as intended.

• Provide transparent, actionable, and technically detailed feedback on identified issues.

• Apply specialized knowledge of developer tooling, AI coding assistants, telemetry, trace analysi

📌 AI-Assisted Developer Workflows (India)
🏢 Jobgether
📍 India