Similar Jobs

See all

About the Role:

  • Evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines.
  • Read documents that include tables and citations, and judge each criterion on its own merits.
  • Write concise, evidence-based rationales that point to concrete evidence.

What You'll Do:

  • Review research responses covering US consumer topics such as personal finance, healthcare, home repair, pets, and travel.
  • Score every criterion independently so that an overall impression doesn't sway individual judgments.
  • Follow guideline updates and calibrate decisions consistently with the QA team.

Must-Have Qualifications:

  • Native or near-native US English (C2) and ability to read long documents with tables and citations.
  • Bachelor's degree or equivalent experience in research, editing, fact-checking, or QA.
  • Proven experience with rubric- or guideline-based evaluation, such as AI rating or search quality rating.

Welo Data

Welo Data is an AI services company specializing in evaluating and improving AI-generated research outputs. The company operates as a freelance, remote team focused on quality and guideline-based evaluation.

Apply for This Position