WE’RE HIRING: Freelance QUALITY ANALYST – AI CHATBOT / LLM EVALUATION

Location: India

Experience: 3+ years

Budget: Rs. 1,30,000 to 164,000 Monthly (Depending on experience)

Availability: Full-time | 8 hours/day

Are you detail-oriented, analytical, and passionate about AI, chatbots, and data quality? This prospect could be for you!

We’re looking for a Quality Analyst to evaluate and compare AI-generated responses, identify quality issues, and ensure outputs meet defined accuracy and quality standards.

Key Responsibilities

- Evaluate and compare responses generated by multiple chatbots.
- Assess accuracy, relevance, completeness, clarity, and adherence to guidelines.
- Identify inconsistencies, inaccuracies, missing information, and subtle errors.
- Provide structured feedback and clear evaluation outcomes.
- Maintain consistency and meet quality, productivity, and turnaround-time targets.
- Collaborate with project teams and escalate ambiguous cases when required.

Required Skills & Qualifications





- 3+ years of experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
- Strong analytical, critical-thinking, and problem-solving skills.
- Excellent written and verbal communication skills.
- High attention to detail and the ability to follow detailed guidelines.
- Comfort working with AI tools, chatbots, and online platforms.
- Ability to work independently and manage multiple tasks.

Good to Have

Experience in chatbot evaluation, LLM testing, Generative AI, AI response evaluation, or data-quality projects.

Work Schedule

- Full-time availability for 8 hours per day.
- Minimum 4 hours of overlap with the US Pacific Time (PST) zone.
- 5 working days per week, including weekends as required, with 2 weekdays off.

Pay: ₹130,000.00 per month

Benefits:

- Flexible schedule
- Work from home

Work Location: Remote

📌 Quality Analyst (India)
🏢 oak tree software solutions
📍 India