Job Summary

We are looking for a Data Annotation Specialist – Code Evaluation & Reasoning to support the development of advanced AI models. In this role, you will analyze, evaluate, and annotate code written in Python and at least one of TypeScript, Java, or Go. Your work will help improve the quality, accuracy, and reasoning capabilities of AI systems.

This is not a software development role. Instead, you'll use your programming knowledge to review code, identify issues, compare solutions, and provide clear technical reasoning following annotation guidelines.

Key Responsibilities

- Evaluate code for correctness, logic, efficiency, and adherence to best practices.
- Review AI-generated code and provide structured annotations and technical feedback.
- Compare multiple code solutions and determine the most appropriate implementation.
- Identify bugs, logical errors, edge cases, and potential security concerns.
- Explain code behavior and reasoning in a clear and concise manner.
- Annotate coding tasks according to project guidelines while maintaining high quality and consistency.
- Assess algorithm efficiency and suggest improvements where applicable.
- Collaborate with project teams to improve annotation quality and AI model performance.
- Maintain accuracy, consistency, and productivity while working on large annotation datasets.

Required Skills

- Strong proficiency in Python.




- Hands-on knowledge of at least one of the following:
- TypeScript
- Java
- Go (Golang)
- Solid understanding of Data Structures and Algorithms.
- Strong code reading, debugging, and code review skills.
- Ability to understand and evaluate unfamiliar code quickly.
- Valuable knowledge of Object-Oriented Programming concepts.
- Strong analytical, logical reasoning, and problem-solving skills.
- Excellent written English and technical communication skills.
- High attention to detail and ability to follow annotation guidelines consistently.
- Preferred Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience in software development, technical content review, code review, QA, or AI data annotation.
- Familiarity with Git, REST APIs, and software development best practices.
- Exposure to Large Language Models (LLMs), Generative AI, or AI-assisted coding tools is an advantage.

What We're Looking For

- Strong analytical thinking and technical reasoning.
- Ability to evaluate code objectively and justify decisions with clear explanations.
- Consistent attention to detail and commitment to quality.
- Comfortable working with structured annotation guidelines and quality metrics.
- Interest in contributing to the development of next-generation AI systems.

📌 Data Annotation Specialist – Code Evaluation & Reasoning (India)
🏢 Coffeee.io
📍 India