Perform side-by-side comparisons of AI-generated responses.
Evaluate outputs for accuracy, relevance, clarity, instruction-following, and overall quality.
Assess AI responses across general-purpose questions and answers, web search results, file-based and image-based responses, content-generation tasks, and single-turn and multi-turn conversations.
We are a technology solutions firm headquartered in Bellevue, Washington, with teams across the United States. We help organizations turn complex challenges into meaningful outcomes by connecting strategy and execution across AI, cloud, data, product development, and emerging technology.
Engage in conversations with a real-time speech-to-speech AI model
Evaluate performance on speech recognition, audio quality, conversation flow, and content accuracy
Provide accurate ratings based on project guidelines within specified timelines
Appen is a global leader in AI training data and crowd-sourced solutions. They work with a large community of independent contractors to improve AI systems through human evaluation.
Evaluate prompts and AI-generated outputs for accuracy, clarity, and cultural appropriateness.
Review and correct text, analyze multimedia content, and contribute voice recordings.
Apply local insight into tone, symbolism, visual cues, and market fit to deliver culturally relevant content.
LILT is an AI company that makes the world's information available to everyone, no matter the language they speak. They work with a global community of linguists and subject matter experts to deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers.
Evaluate AI-generated documents and presentations against quality standards.
Apply humanities expertise to identify inaccuracies and cultural issues.
Provide structured feedback to improve AI model performance.
A partner company is seeking a humanities evaluator to assess AI-generated content for accuracy and quality. The company emphasizes cultural awareness and critical thinking in a remote, asynchronous work environment.
Evaluate AI-generated text and audio in Catalan for accuracy and natural flow.
Provide corrections and constructive feedback on grammar, tone, and cultural context.
Complete approximately 10 hours of asynchronous tasks each week via our online platform.
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Evaluate machine translations from English to Spanish (Spain) to improve translation engine accuracy.
Work as an independent contractor with flexible hours, completing files at your own pace.
Must be a native Spanish speaker with strong English proficiency and reside in Spain.
CrowdGen by Appen connects independent contractors with AI training projects, including machine translation evaluation. The company is part of Appen, a global leader in AI training data, and fosters a flexible, remote work culture.
Test and evaluate AI chatbots and language models through structured conversations using assigned criteria.
Assess AI-generated responses for quality, relevance, safety, and linguistic accuracy.
Submit accurate deliverables such as written evaluations, ratings, and audio recordings within required timelines.
This company specializes in AI development and data evaluation, focusing on improving generative AI systems. The organization operates with a flexible, project-based team and values linguistic expertise.
Rating and assessing the performance of AI models based on their output or behavior.
Labeling and categorizing content to train machine learning models.
Generating prompts, responses, and summaries to improve language model reasoning.
Innodata is a global data engineering company that provides data, evaluation frameworks, and human expertise for AI systems. With over 36 years of experience, the company focuses on enabling responsible AI advancement.
Review, evaluate, and annotate AI-generated content across text, images, audio, and video.
Perform quality checks to ensure accuracy, consistency, and compliance with project guidelines.
Identify edge cases and inconsistencies, contribute to high-quality dataset development, and participate in calibration activities.
Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors that provides high-quality, ethical data for training advanced AI systems. The company supports a diverse, global community across 100+ countries and offers project-based freelance opportunities with flexibility and growth potential.
Evaluate prompts and AI-generated outputs for accuracy, cultural appropriateness, and brand alignment.
Review and correct text, analyze multimedia content, and contribute voice recordings.
Apply local cultural insight and consistent evaluation guidelines to ensure high-quality AI training.
Lilt provides multilingual AI and human-verified services to enterprises, governments, and AI developers. They foster a global community of linguists and subject matter experts working on cutting-edge AI and language technology.
Label and evaluate photos, graphics, videos, stickers, and designs in Dutch for linguistic accuracy and cultural appropriateness.
Assess AI-generated content against Canva's quality bar for Dutch users to shape localised AI experiences.
Build and contribute to Dutch-specific datasets and deliver labelled assets on time across varied task types.
Canva is redefining how the world experiences design, empowering users to create visual content. The company has a global team and supports flexible, remote-friendly work, with a focus on collaboration and innovation.
Review search results and evaluate their relevance to user queries
Answer true/false questions about content quality
Rate search results based on guidelines to improve AI systems
Welo Data provides AI services and data validation to improve search engine and AI systems. They are a remote-first company with a focus on quality and support for their contractors.
Evaluate AI-generated French responses, rate them, and flag cultural issues.
Rewrite weak responses into clear, natural Canadian French.
Create original French prompts and example responses to expand training data.
We are a global AI data company that delivers high-quality, ethical data to train the world's most advanced AI systems. With over 500,000 contributors, we offer flexible, remote project-based opportunities with a supportive global community.
Evaluate AI-generated documents, spreadsheets, and presentation decks against quality rubrics.
Identify factual, formatting, visual, and structural issues in professional deliverables.
Provide clear, structured feedback to enhance AI output quality and consistency.
This partner company specializes in AI training and evaluation, focusing on improving the quality of AI-generated professional content. Operating as a remote and asynchronous team, they value precision, collaboration, and independent work.
Side-by-side evaluation of text and voice snippets to assess quality and authenticity.
Naturalness assessment of AI-generated audio to rate how natural the voice sounds.
Quality control to identify where the AI's tone or pronunciation feels unnatural or culturally mismatched.
Prolific builds the largest pool of quality human data for AI development. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants.
Curate and annotate multilingual audio data to train AI for voice interactions and speech recognition.
Ensure high-quality voice recordings and accurate transcriptions across diverse languages and accents.
Collaborate with technical staff to improve annotation tools and audio workflows.
SpaceXAI creates AI systems to understand the universe and aid humanity in its pursuit of knowledge. The team is small, highly motivated, and focused on engineering excellence.
Review AI-generated responses against source images and quality guidelines.
Identify issues like hallucinations, missing details, or policy violations.
Provide structured feedback to improve model performance and output quality.
Jobgether uses AI-powered matching to connect candidates with partner companies. They focus on efficient, objective hiring processes and operate as a platform for remote opportunities.
Contribute to building smarter, more accurate AI by annotating, evaluating, and creating prompts for language models.
Work flexibly on your own terms with remote projects that fit your schedule and skills.
Be part of a global community of linguists and tech enthusiasts shaping the future of AI.
We are a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world's most advanced AI systems. We are building a diverse community in 100+ countries, offering flexible remote work and limitless opportunities for growth.
Lead and support a team of approximately 10 Quality Control Reviewers, ensuring consistent quality standards across the Spanish (Spain) locale.
Act as the primary quality point of contact for the Spanish (Spain) locale, resolving quality questions and escalating complex issues when necessary.
Conduct calibration sessions and provide structured coaching to improve reviewer performance.
Welo Data provides data quality services for AI training programs, focusing on linguistic quality and annotation. The team is dedicated to improving AI systems through rigorous quality assurance and collaboration.
Review and grade internet advertisements to help shape ad delivery based on user keywords.
Work remotely with a flexible schedule, minimum 5 hours per week, up to 20 hours.
Use both English and Spanish to evaluate ads and provide feedback.
Welo Data is an award-winning localization and data transformation company that runs one of the world’s largest Ads Rating Programs. The company offers a multicultural and international environment with opportunities for professional development and human support 24/6.