About the Opportunity
This opportunity is for experienced Product Managers and Product Owners to contribute to an advanced project focused on AI system development and evaluation.
In this role, you'll apply your product expertise to help train next-generation AI systems through high-quality, real-world input. You'll evaluate AI-generated content and assess how effectively it meets product, audience, and communication requirements.
No prior AI experience is required — your product management and product ownership expertise is what matters.
Important Scope Note
This is strictly an evaluation and analysis prospect. The engagement does not involve roadmap ownership, delivery management, sprint facilitation, stakeholder leadership, or programme governance.
Candidates whose primary backgrounds are in project management, programme management, delivery management, or Scrum leadership are not the intended fit for this engagement.
Key Responsibilities
• Assess and compare AI-generated responses to a variety of product and business writing prompts.
• Evaluate content including product specifications, release notes, user-facing copy, and stakeholder updates.
• Score responses based on clarity, tone, instruction adherence, accuracy, and usefulness for the intended audience.
• Write detailed evaluation rationales explaining the reasoning behind each assessment.
• Determine whether generated content appropriately addresses prompt requirements and audience needs.
• Identify cases where fluent or well-written content fails to answer the underlying question or is unsuitable for its intended users.
• Detect factual inaccuracies, inconsistencies, omissions, and constraint violations.
• Collaborate virtually and asynchronously with project managers and reviewers to maintain consistency and quality across evaluations.