Role Overview

We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research.

SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed prospects for clarification, and provide structured feedback to improve conversational quality.

Key Responsibilities
Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
Identify missing context and recommend relevant follow-up questions.
Evaluate whether additional information would have changed the AI's recommendations.
Distinguish between critical ("load-bearing") and non-essential information.
Conduct qualitative reviews and document findings using structured evaluation guidelines.
Collaborate with research teams to ensure consistent, high-quality assessments.

Required Qualification:
MSW with LCSW or equivalent social work license.
MA/MS with LMFT, LPC, LCPC,



or equivalent counseling license.
PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
MA/PhD in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research, or a related field.
Relevant qualified credential with 5+ years of direct advisory, client-facing, coaching, mediation, or consulting experience.

Preferred:
35+ years of qualified practice.
Experience eliciting missing context through interviews, consultations, or assessments.
Experience with qualitative coding, case review, or conversation analysis.
Ability to identify information that is critical versus non-essential for decision-making.
Prior AI/LLM evaluation, annotation, or conversational AI research experience is a plus.

Offer Details:
Commitments Required: 40 hours per week with at least 4 hours PST overlap
Employment type : Contractor assignment (no medical/paid leave)
Duration of contract : 4 weeks
Payment Model: Pay-per-task

📌 Context Elicitation & Conversation Evaluation Expert Bengaluru
🏢 Turing Global India
📍 Bengaluru