06 Nov
|
Sourcebae
|
India
Job Title: LLM – Business Analyst Experience: 5+ Years
We are seeking a detail-oriented Business Analyst to support Large Language Model (LLM) evaluation and annotation workflows. This role focuses on assessing quality, accuracy, and structured reasoning in model outputs. The ideal candidate is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, evidence-based justifications through fact-checking.
This is an evaluation and quality-focused role— no model training or coding expertise is required .
Perform side-by-side (SxS) evaluations on GHD outputs, assessing quality, accuracy, relevance, and reasoning
Follow established evaluation guidelines and quality standards consistently
Use browser-based tools and extensions to support review and analysis tasks
Execute basic command-line instructions when required (no advanced programming)
5+ years of professional experience
- Strong comfort using a computer in a professional setting
- Experience working with browser extensions and online tools
- Comfortable working with evaluation frameworks, comparisons, and structured analysis
- Positive written communication skills in English
Previous experience in evaluation, annotation, QA, or audit-type roles
Familiarity with data quality, content evaluation, or model/output assessments
Background in business analysis, operations, or process improvement
Stay updated with our latest job opportunities and company news by following us on LinkedIn: :
📌 Business Analyst - English Speaker (India)
🏢 Sourcebae
📍 India