Similar Jobs

See all

Overview:

  • We're looking for a QA Audio Rater to ensure rating quality and consistency during the initial phase of our audio rating program.
  • You'll audit rater output, catch calibration issues early, and help keep the rating pool aligned and accurate.

Responsibilities:

  • Audit 30% of production output generated during the initial phase (Pilot).
  • Identify and flag miscalibration or inconsistent scoring across raters.
  • Provide clear, actionable feedback and corrections to raters.
  • Complete onboarding and training ahead of the production pool's rollout.

Requirements:

  • Strong attention to detail and consistency in judgment.
  • Ability to spot patterns of miscalibration and articulate clear feedback.
  • Comfortable working independently during a pilot or early-stage phase.
  • Prior experience in QA, auditing, or rating work is a plus.

Welo Data

Welo Data provides AI services and data solutions for machine learning and artificial intelligence projects. They are a growing community of freelancers and contractors working on various AI-related tasks.

Apply for This Position