Source Job

Australia

  • Listen to short audio clips in Chinese (Mandarin, Putonghua) and evaluate them using a defined rubric.
  • Accurately identify target accents from provided audio samples.
  • Apply consistent and objective judgment based on provided evaluation guidelines.

13 jobs similar to Audio Evaluator

Jobs ranked by similarity.

Global

  • Listen to short audio clips in Russian and evaluate them using a defined rubric.
  • Accurately identify target accents from provided audio samples.
  • Compare multiple recordings and assess which one sounds more natural in relation to the target accent.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.

Europe Global

  • Record short audio clips in both of your native languages following project guidelines.
  • Ensure recordings meet quality, clarity, and accuracy standards.
  • Collaborate with our global community to deliver consistent, high-quality data.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.

Global

  • Completing AI training tasks such as analyzing, editing, and writing in Mandarin
  • Judging the performance of AI in performing Mandarin prompts
  • Improving cutting-edge AI models

Prolific is building the biggest pool of quality human data in the world and is not just another player in the AI space. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

Indonesia

  • Review short, pre-segmented datasets.
  • Evaluate model-generated replies based on Tone or Fluency .
  • Read a user prompt and two model replies, then rate each using a five-point scale.

CrowdGen, by Appen, focuses on AI response evaluation. They are looking for native Javanese speakers to contribute to a multilingual AI response evaluation project where you review large language model outputs.

Global

  • Evaluate AI-generated Japanese speech and text for linguistic accuracy, naturalness, and educational quality.
  • Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
  • Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.

Alignerr partners with leading AI labs to build expert-driven data pipelines that improve how models reason, learn, and communicate. They work with domain specialists around the world to evaluate and refine AI systems in areas where precision, pedagogy, and human judgment matter most.

Europe

  • Evaluate AI-generated responses for accuracy, grammar, and cultural relevance.
  • Identify issues and provide refined, high-quality rewritten responses.
  • Create natural prompts and responses in Spanish to improve conversational datasets.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They're building smarter, more human AI with a diverse community in 100+ countries.

Global

  • Native or near-native fluency in Central Khmer.
  • Based in: Cambodia, Thailand.
  • Comfortable with digital tools.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They’re building smarter, more human AI with a diverse community in 100+ countries.

US

  • Call restaurants to identify whether the owner speaks Mandarin or English. Record accurate language preference and contact details in our system.

Beyond Menu is a fast-growing restaurant technology company helping independent restaurants thrive with online ordering, marketing, and growth tools. They value accurate data and are looking for detail-oriented individuals to support their sales team.

$25–$30/hr
Global

  • Evaluate AI-generated French speech and text for linguistic accuracy, naturalness, and educational quality.
  • Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
  • Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.

Alignerr partners with leading AI labs to build expert-driven data pipelines. They improve how models reason, learn, and communicate by working with domain specialists to evaluate and refine AI systems where precision, pedagogy, and human judgment matter most.

  • Record short, conversational audio clips in Dutch based on a provided script.
  • Simulate natural background environments such as a car, café, or office.
  • Follow specific guidelines to ensure clarity, consistency, and a natural delivery.

Welocalize enables brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources.

  • Design scenario-based and edge-case prompts to test AI behavior.
  • Develop evaluation rubrics to assess AI responses across multiple criteria.
  • Perform side-by-side evaluations of AI outputs and score them using defined criteria.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.