Design complex evaluation frameworks and execute role-play scenarios simulating realistic customer service interactions.
Audit AI model performance across standardized metrics, focusing on task completion, conversational naturalness, and audio comprehension.
Generate diverse, high-quality audio datasets and assess basic computer programming literacy in JSON and structured data reasoning.
The company is an AI benchmarking project that evaluates advanced agentic audio models through simulated customer support scenarios. It is a freelance contractor project with no specific company size or culture mentioned beyond the project scope.
Participate in short voice conversations with AI models using a designated platform, following provided scenarios and prompts.
Evaluate AI responses based on relevance, accuracy, clarity, and overall quality, providing objective ratings and feedback.
Complete assigned tasks within established quality and productivity expectations, with a flexible schedule of 10+ hours per week.
RWS is a provider of technology-enabled language, content management, and intellectual property services. As an equal opportunity employer, they embrace diversity and inclusion, offering flexible remote work opportunities for freelancers and private individuals.
Evaluate AI-generated Tamil audio for natural emotional and cultural nuance.
Perform sentiment analysis to assess model’s conveyance of intonations and feelings.
Identify and report unnatural or culturally mismatched tones in AI output.
Prolific builds the biggest pool of quality human data in the world, connecting researchers with over 35,000 paid study participants. It is a platform that enables the collection of high-quality, ethically sourced human behavioral data for AI development.
Engage in conversations with a real-time speech-to-speech AI model.
Evaluate performance based on speech recognition, audio quality, conversation flow, and content accuracy.
Provide accurate and consistent ratings based on project guidelines.
Appen is a company that focuses on improving real-time conversational AI. They leverage independent contractors and project-based opportunities to enhance multilingual voice interactions. They seem to foster a community-driven environment.
Evaluate Korean-English translations produced by an AI chatbot for accuracy and adherence to user-specified requirements.
Apply MQM error annotations, verify auto-generated rubric items, and evaluate each item as Pass or Fail.
Ensure consistent and accurate ratings while completing assigned tasks within given timelines.
Appen helps improve AI-powered translation systems through crowd-based evaluation projects. They are a large global company offering project-based independent contractor roles, fostering a culture of flexibility and remote work.
Review, evaluate, and annotate AI-generated content across text, images, audio, and video.
Perform quality checks to ensure accuracy, consistency, and compliance with guidelines.
Identify edge cases and contribute to high-quality datasets for training advanced AI models.
Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors delivering high-quality, ethical data to train advanced AI systems. They foster a diverse community across 100+ countries and offer flexible, project-based opportunities with complete autonomy.
Listen to recorded audio files in the target language.
Transcribe conversations accurately and clearly, following formatting and transcription guidelines.
Review and correct transcription errors when needed, completing assigned tasks within the required deadlines.
Terry Soot Management Group (TSMG) is a field data collection company founded in 2017 in Europe. We collect data where automation is not possible, supporting projects involving speech recording, transcription, image and video collection, mapping, and AI training across Europe and North America.
Conduct second-pass quality reviews to ensure linguistic accuracy and consistency across batches.
Validate severity assessments and identify systemic MT quality issues such as recurring error patterns.
Provide high-level qualitative feedback to support final quality reporting and continuous improvement.
Welo Data provides AI services, focusing on language and data solutions for machine learning. They operate as a flexible, freelance-based organization with ongoing project needs.
Transcribe 5-second audio clips of English dialects accurately according to style guide.
Flag audio issues such as background noise or cut-off speech using simple codes.
Work flexible hours with an average completion time of ~125 seconds per task.
Welo Data, part of Welocalize, is a global AI data company that delivers high-quality, ethical data to train the world’s most advanced AI systems. With over 500,000 contributors in 100+ countries, the company values diversity and community.
Apply deep knowledge of Taiwanese grammar, syntax, and morphology to challenge and refine advanced language models.
Document model failure modes in areas like verb conjugation, case systems, and stylistic variation to improve AI reasoning.
Collaborate on prompt engineering and evaluation metrics through precise, metacognitive communication.
Greenhouse powers the next generation of AI by leveraging language expertise to train advanced models. They operate as a freelance contractor platform seeking specialized language professionals for AI training projects.
Identify and label languages and dialects from model-generated responses.
Review outputs from two different AI models and determine which model correctly identified the proposed language.
Compare model responses and select the appropriate evaluation outcome from predefined options
RWS – TrainAI is looking for Language Data Annotators. They embrace DEI and promotes equal opportunity and prohibits discrimination and harassment of any kind.
Review, refine, and validate AI translation prompts for attraction and travel content.
Optimize AI-generated translations to meet standards of naturalness and fluency.
Test and refine language prompts to ensure output meets cultural relevance.
Welo Data is an AI services company. We are looking for talented people to join our community and contribute to exciting projects related to artificial intelligence.
Collaborate with advanced language models on software engineering tasks in Spanish (Latin America), documenting failure modes to improve model reasoning.
Verify logical accuracy, coding fluency, and naturalness of Spanish language usage in model outputs.
Capture reproducible error traces and suggest improvements to prompt engineering and evaluation metrics.
The company is working on large-scale language models for scientific discovery and software development, aiming to democratize education and streamline engineering. The project is freelance-based and seeks coding specialists fluent in Spanish (Latin America) to train AI, with no specified company size or culture.
Work in an AI-powered platform to review and refine synthetic speech
Rate dubbed media content for Portuguese and German audiences
Evaluate voice profiles and ensure high-quality dubbing output
RWS is a technology-enabled language services company specializing in localization and content management. They are a large global organization with a focus on innovation and diversity, offering freelance opportunities.
Contribute to AI training through annotation, evaluation, and prompt creation from anywhere.
Use your native Serbian fluency to help build more accurate and inclusive AI.
Join a global network of contributors with flexible projects that fit your schedule.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They offer flexible, remote opportunities for a diverse community in 100+ countries, building smarter, more human AI.
Review short audio transcriptions (~5 seconds) for accuracy and adherence to guidelines.
Approve correct transcriptions or reject with specific, actionable written feedback.
Identify and correct errors in punctuation, formatting, and style-guide application.
Welo Data, part of Welocalize, is a global AI data company delivering high-quality, ethical data to train AI systems. They have 500,000+ contributors and build smarter, more human AI with a diverse community in 100+ countries.
Engage in natural conversations with two AI models and evaluate their performances.
Compare and rank models based on provided criteria after each dialogue.
Submit pass/fail votes for each model to help improve AI quality.
An enterprise client helps innovative companies improve their AI models through human feedback. They are seeking a high volume of freelancers for conversational AI training tasks.
Participants will complete recorded search sessions focused on a unique primary search query.
All recordings must follow the project’s recording, safety, and privacy guidelines.
Contributors are encouraged to interact naturally with the platform.
CrowdGen by Appen is a company that focuses on AI training data. They provide opportunities to work on real-world computer vision and OCR-related projects as an Independent Contractor.
Audit and evaluate chatbot conversations based on core dimensions.
Follow project-specific guidelines for accurate evaluations.
Use a proprietary client platform to complete tasks.
RWS Group provides technology-enabled language, content management and intellectual property services. They embrace DEI and promote equal opportunity; they are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind.