Review real user interaction traces with an AI shopping assistant
Identify logical failures, inaccuracies, or poor recommendations in the text
Create structured rubrics and verifiers to judge response quality
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Evaluate AI-generated coding interactions end to end for usefulness, accuracy, and consistency with strong engineering practices.
Assess whether coding agents demonstrate sound technical reasoning and practical engineering judgment rather than just producing working-looking code.
Provide actionable feedback, distinguishing between adequate and exceptional AI response quality to shape evaluation standards.
Jobgether uses an AI-powered matching process to ensure your application is reviewed quickly and fairly against the role's core requirements. They are a third-party recruitment platform that partners with companies to fill positions, with a streamlined selection process.
Evaluate AI-generated customer support materials against quality rubrics.
Review documents, spreadsheets, and presentations for accuracy and consistency.
Provide structured feedback to improve AI system performance.
The company is a partner firm specializing in AI system development and evaluation. It operates remotely with a focus on professional expertise and flexible contract work.
Evaluate AI-generated documents, spreadsheets, and presentation decks against quality rubrics.
Identify factual, formatting, visual, and structural issues in professional deliverables.
Provide clear, structured feedback to enhance AI output quality and consistency.
This partner company specializes in AI training and evaluation, focusing on improving the quality of AI-generated professional content. Operating as a remote and asynchronous team, they value precision, collaboration, and independent work.
Review and advise on evaluation criteria and scoring rubrics for AI-generated outputs.
Create, edit, and validate high-quality benchmark tasks and reference data for AI training.
Analyze model failures, including hallucinations and flawed reasoning, providing expert explanations.
The company specializes in AI evaluation and training, helping define standards for next-generation AI systems. They operate as a partner company that manages applications and next steps, valuing autonomy and expertise in their consultants.
Evaluate LLM responses for accuracy, clarity, and completeness.
Fact-check technical claims using authoritative references.
Validate code and outputs, and annotate model performance.
Prolific builds the largest pool of high-quality human data for AI development, serving over 35,000 AI developers, researchers, and organizations. They connect researchers with a global community to collect ethically sourced behavioral data.
Evaluate AI-generated content for quality, accuracy, and cultural relevance
Apply Castilian Spanish expertise to assess response appropriateness for Spain
Provide structured feedback and document decisions to improve AI performance
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. They use objective, data-driven recruitment processes and prioritize privacy and fairness.
Write detailed outlines of your regular workflows, focusing on one critical task performed at least weekly.
Provide structured evaluation tasks and nuanced feedback to train AI models.
Complete paid tasks remotely on a freelance basis, with most tasks requiring one hour of uninterrupted work.
Prolific builds the world's largest pool of quality human data for AI development. With over 35,000 AI developers and organizations using its platform, it focuses on ethically sourced behavioral data from paid participants.
Evaluate AI agent conversations for acute symptom triage, diabetes management, and travel health guidance.
Score and annotate agent performance using structured rubrics and provide actionable feedback.
Participate in calibration sessions and help refine test scenarios for clinical safety.
Hippocratic AI develops AI-driven clinical agents to support healthcare delivery. As a specialized AI company, it focuses on patient safety and clinical accuracy, engaging clinical experts to evaluate and refine its systems.
Review search queries and evaluate personalized place recommendations based on your activity history.
Rate the relevance and usefulness of suggested places according to project guidelines.
Complete tasks accurately while following dynamic project schedules and requirements.
Welo Data provides AI services, including data annotation and evaluation for machine learning models. They operate with a global network of remote freelancers and prioritize accuracy and critical thinking.
Evaluate AI-generated spreadsheets against quality standards and domain-specific rubrics.
Identify calculation errors, formatting issues, and inconsistencies in workbooks.
Provide structured, actionable feedback to improve AI output accuracy and usability.
The partner company focuses on evaluating AI-generated spreadsheets and workbooks. It offers a remote, asynchronous work environment with flexible scheduling.
Review, evaluate, and validate AI-generated content and data according to project guidelines.
Compare AI outputs and identify the most accurate, relevant, or high-quality results.
Annotate, categorize, or label text, audio, images, video, or other data with clear feedback.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They offer limitless flexibility and growth for a diverse community in 100+ countries.
Evaluate AI-generated support replies for accuracy and brand voice consistency.
Simulate realistic customer interactions to test AI handling of edge cases.
Audit AI-generated FAQ articles and knowledge bases for technical correctness.
Prolific is building the world's largest pool of quality human data for AI development. They connect researchers with paid participants to gather diverse behavioral data, and are at the forefront of ethical AI data collection.
Evaluate AI-generated documents and presentations against quality standards.
Apply humanities expertise to identify inaccuracies and cultural issues.
Provide structured feedback to improve AI model performance.
A partner company is seeking a humanities evaluator to assess AI-generated content for accuracy and quality. The company emphasizes cultural awareness and critical thinking in a remote, asynchronous work environment.
Evaluate AI-generated legal research and analysis for accuracy, relevance, and completeness.
Verify legal citations, authorities, and reasoning to identify errors and weaknesses.
Develop objective evaluation criteria and provide structured feedback to improve AI legal content.
Jobgether uses an AI-powered matching process to connect top-fitting candidates with hiring companies. They prioritize objective and fair review, sharing shortlists directly with employers for final decisions.
Evaluate AI coding-agent interactions for technical accuracy and engineering judgment.
Assess explanations and reasoning to ensure they genuinely help developers.
Provide structured feedback to improve AI-assisted development experience.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective AI-based review. The role is posted on behalf of a partner company that develops AI coding tools.
Evaluate AI-generated documents, spreadsheets, and presentations for privacy and regulatory compliance accuracy.
Apply domain expertise to assess outputs against defined quality standards and provide actionable feedback.
Contribute to improving AI systems by providing expert judgment and structured feedback.
The company is a partner of Jobgether, offering remote opportunities for privacy and compliance professionals to evaluate AI-generated content. The company values autonomy and flexibility, providing independent contractor arrangements.
Research eCommerce brands, products, competitors, and markets to uncover useful insights.
Analyze competitor ads, messaging, offers, and customer psychology to identify patterns.
Document research clearly using internal templates and AI tools to support CRO strategists.
Fuelerate is a growth partner for Shopify brands, scaling eCommerce stores using data, testing, and design that actually sells. They are a fast-moving, fully remote team focused on impact and ownership.