Listen to short audio clips in Chinese (Mandarin, Putonghua) and evaluate them using a defined rubric.
Accurately identify target accents from provided audio samples.
Apply consistent and objective judgment based on provided evaluation guidelines.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.
Record short audio clips in both of your native languages following project guidelines.
Ensure recordings meet quality, clarity, and accuracy standards.
Collaborate with our global community to deliver consistent, high-quality data.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.
Evaluate model-generated replies based on Tone or Fluency .
Read a user prompt and two model replies, then rate each using a five-point scale.
CrowdGen, by Appen, focuses on AI response evaluation. They are looking for native Javanese speakers to contribute to a multilingual AI response evaluation project where you review large language model outputs.
Evaluate AI-generated responses for accuracy, grammar, and cultural relevance.
Identify issues and provide refined, high-quality rewritten responses.
Create natural prompts and responses in Spanish to improve conversational datasets.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They're building smarter, more human AI with a diverse community in 100+ countries.
Evaluate AI-generated Japanese speech and text for linguistic accuracy, naturalness, and educational quality.
Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.
Alignerr partners with leading AI labs to build expert-driven data pipelines that improve how models reason, learn, and communicate. They work with domain specialists around the world to evaluate and refine AI systems in areas where precision, pedagogy, and human judgment matter most.
Evaluate AI-generated French speech and text for linguistic accuracy, naturalness, and educational quality.
Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.
Alignerr partners with leading AI labs to build expert-driven data pipelines. They improve how models reason, learn, and communicate by working with domain specialists to evaluate and refine AI systems where precision, pedagogy, and human judgment matter most.
Completing AI training tasks such as analyzing, editing, and writing in Mandarin
Judging the performance of AI in performing Mandarin prompts
Improving cutting-edge AI models
Prolific is building the biggest pool of quality human data in the world and is not just another player in the AI space. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They’re building smarter, more human AI with a diverse community in 100+ countries.
Evaluate LLM-generated transcriptions on their ability to effectively understand conversations from an audio recording.
Generate high-quality human annotations to correct model-generated transcripts.
Apply consistent annotations by following clear taxonomies and detailed evaluation guidelines.
Neon partners with leading AI teams to improve the quality, usefulness, and reliability of audio-based AI systems. Projects focus on evaluating and improving transcriptions of audio recordings generated by large language models (LLMs).
Record short, conversational audio clips in Dutch based on a provided script.
Simulate natural background environments such as a car, café, or office.
Follow specific guidelines to ensure clarity, consistency, and a natural delivery.
Welocalize enables brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources.
Object tagging and labeling across different content types (audio, video, images, or collected data)
RWS enhances communication and delivers value. They embrace DEI and promote equal opportunity, committed to a work environment free of discrimination and harassment.
Design scenario-based and edge-case prompts to test AI behavior.
Develop evaluation rubrics to assess AI responses across multiple criteria.
Perform side-by-side evaluations of AI outputs and score them using defined criteria.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.