Role Overview

Evaluate and compare the quality of responses from multiple AI chatbots across real-world small business use cases.

Responsibilities

· Create realistic business-related prompts based on defined user goals

· Interact with multiple AI chatbots (max. 5 turns per conversation)

· Assess response quality across clarity, usefulness, and accuracy

· Provide structured feedback and comparative evaluations

· Submit conversation transcripts and evaluation results

Requirements

· Business owner or strong understanding of small business operations

· Talents must have business-related documents available in English.

· Strong analytical and critical thinking skills

· Ability to follow structured evaluation guidelines

· Comfortable interacting with AI tools

What you'll work on

· Create engaging visual content for marketing

· Help answer and evaluate situations related to day-to-day operations and customer interactions

· Conduct market research and contribute ideas in your area of expertise

· Work with data to support analysis and financial planning





· Review and evaluate AI-generated responses for small business use cases

· Use tools and input files such as spreadsheets, PDFs, and images as part of your workflow

Application Question(s):
- Do you currently own or operate a small business, or do you have robust hands-on experience managing small business operations?
- How many years of experience do you have in running/managing a business or working closely with small business operations?
- Are you comfortable working with AI chatbots and evaluating the quality of their responses?
- Have you previously used AI tools such as ChatGPT, Gemini, Claude, or similar tools for business-related tasks?
- Are you comfortable creating realistic prompts based on real-world small business scenarios and comparing responses from multiple AI chatbots?
- Do you have business-related documents in English (such as spreadsheets, PDFs, financial records, marketing materials

📌 Small business owners AI (India)
🏢 Idyaite Technology Solutions Private
📍 India