Source Job

United States

  • Review search results and evaluate their relevance to user queries
  • Answer true/false questions about content quality
  • Rate search results based on guidelines to improve AI systems

English Fluency Attention To Detail Computer Literacy

20 jobs similar to Search Quality Rater

Jobs ranked by similarity.

Canada

  • Review search queries with personalized results based on your activity history.
  • Evaluate suggested places, such as restaurants or locations, related to places you've previously visited.
  • Rate the relevance and usefulness of suggested places and follow project guidelines.

Welo Data provides AI services, including data annotation and evaluation for machine learning models. They operate with a freelance workforce and focus on quality and accuracy in digital experiences.

Global

  • Write prompts in Luxembourgish to test AI models and evaluate responses using a structured rating guide.
  • Identify areas for improvement in AI responses and provide accurate English translations.
  • Work remotely on a flexible schedule with competitive pay.

CrowdGen by Appen is a platform that connects freelancers to help improve AI models through data annotation and evaluation. It is part of a large global company with a diverse community of independent contractors working remotely.

US

  • Evaluate simulated advertiser-AI conversations for technical accuracy and campaign structure.
  • Fact-check platform strategies against correct hierarchy and full-funnel metrics.
  • Write clear, actionable feedback to correct errors and improve AI model performance.

RWS specializes in AI training data and language services, providing data annotation and evaluation solutions to improve AI model reliability. The company fosters a culture of diversity and inclusion, operating as a global employer with a focus on equal opportunity.

Global

  • Contribute to AI training through annotation, evaluation, and prompt creation tasks.
  • Work flexibly on remote projects that match your skills and availability.
  • Be part of a global community shaping safer, smarter AI.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.

$24–$24/hr
Germany

  • Provide expert rating support and guidance, enhancing the skills of other raters on AI-powered advertising systems.
  • Analyze datasets, identify patterns, and use KPIs to drive data-informed decisions for quality improvements.
  • Collaborate with clients and teams to conduct test rounds, ensure quality benchmarks, and maintain rating proficiency.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. The company values limitless flexibility and growth, offering a supportive global community for its contributors.

Global

  • Review recorded DET sessions end-to-end, analyzing test taker behavior and verifying identity compliance.
  • Document infractions and make evidence-based validity decisions within expected timeframes.
  • Complete monthly calibration sets and attend remote meetings to ensure decision accuracy.

Duolingo develops the best education in the world and makes it universally available. The company has over half a billion learners globally and fosters a culture of experimentation, fact-based decisions, and collaboration.

  • Evaluate prompts and AI-generated outputs for accuracy, cultural appropriateness, and brand alignment.
  • Review and correct text, analyze multimedia content, and contribute voice recordings.
  • Apply local cultural insight and consistent evaluation guidelines to ensure high-quality AI training.

Lilt provides multilingual AI and human-verified services to enterprises, governments, and AI developers. They foster a global community of linguists and subject matter experts working on cutting-edge AI and language technology.

Argentina

  • Review and grade internet advertisements to help shape ad delivery based on user keywords.
  • Work remotely with a flexible schedule, minimum 5 hours per week, up to 20 hours.
  • Use both English and Spanish to evaluate ads and provide feedback.

Welo Data is an award-winning localization and data transformation company that runs one of the world’s largest Ads Rating Programs. The company offers a multicultural and international environment with opportunities for professional development and human support 24/6.

$4–$5/hr
Global

  • Review AI-generated responses against source images and quality guidelines.
  • Identify issues like hallucinations, missing details, or policy violations.
  • Provide structured feedback to improve model performance and output quality.

Jobgether uses AI-powered matching to connect candidates with partner companies. They focus on efficient, objective hiring processes and operate as a platform for remote opportunities.

Canada

  • Evaluate and assess AI model outputs based on predefined quality, accuracy, relevance, and behavioral guidelines.
  • Annotate, classify, and label text, images, or audio to support AI model training.
  • Create prompts and generate high-quality responses to improve language model reasoning capabilities.

Jobgether uses an AI-powered matching process to connect candidates with hiring companies. They focus on efficient, fair recruitment and handle data privacy in compliance with GDPR.

United States Latin America

  • Own the design and defense of frontier model evaluations across reasoning, coding, agents, tool use, and multi-modal.
  • Build benchmark packages with expert-verified ground truth, multi-model headroom results, and rigorous QC.
  • Recruit, calibrate, and review a pool of subject-matter experts in coding, agentic/tool-use, and STEM/reasoning.

Anyone AI measures frontier model capability through expert-verified evaluation packages. The company operates as a remote team with a focus on rigorous benchmarking and lab collaboration.

Global

  • Write prompts in Slovak to test AI models.
  • Evaluate AI responses using a structured rating guide.
  • Translate prompts and evaluations into English.

CrowdGen by Appen provides AI training data services to improve machine learning models. They operate a global community of independent contractors and emphasize flexible, remote work.

Netherlands

  • Label and evaluate photos, graphics, videos, stickers, and designs in Dutch for linguistic accuracy and cultural appropriateness.
  • Assess AI-generated content against Canva's quality bar for Dutch users to shape localised AI experiences.
  • Build and contribute to Dutch-specific datasets and deliver labelled assets on time across varied task types.

Canva is redefining how the world experiences design, empowering users to create visual content. The company has a global team and supports flexible, remote-friendly work, with a focus on collaboration and innovation.

US

  • Work remotely to correct captions for Deaf and Hard of Hearing users in real-time.
  • Must have strong comprehension of various spoken English accents, especially deaf accents.
  • Typing speed and reliability are key, with a commitment of 5-15 hours per week.

Ava aims to radically improve communication by empowering deaf and hard-of-hearing people with live captioning. Their small but fast-growing team has reinvented AI-based speech recognition technology to be in service of those who need it most.

Global

  • Evaluate prompts and AI-generated outputs for accuracy, clarity, and cultural appropriateness.
  • Review and correct text, analyze multimedia content, and contribute voice recordings.
  • Apply local insight into tone, symbolism, visual cues, and market fit to deliver culturally relevant content.

LILT is an AI company that makes the world's information available to everyone, no matter the language they speak. They work with a global community of linguists and subject matter experts to deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers.

  • Listen to short Scottish English text-to-speech clips and rate their naturalness and pleasantness.
  • Complete tasks on the ADAP platform within 2-3 days of availability.
  • Must be a native Scottish English speaker residing in Scotland, UK with a computer and reliable internet.

CrowdGen by Appen is a platform that connects independent contractors with AI training tasks. It is a large, global crowdsourcing company that offers flexible, project-based opportunities.

Global

  • Evaluate AI-generated text and voice snippets in Punjabi for naturalness and authenticity.
  • Assess audio clips for cultural and tonal accuracy of AI speech.
  • Provide feedback on linguistic nuance and quality of AI outputs.

Prolific builds the biggest pool of quality human data in the world, serving over 35,000 AI developers and researchers. The company connects researchers with paid study participants from diverse backgrounds to gather high-quality, ethically sourced behavioral data.

Global

  • Test online sweepstakes registration processes and user journeys.
  • Evaluate platform usability, features, and overall user experience.
  • Produce clear, well-structured reviews and editorial content.

We are a growth agency that helps brands connect with top-tier people for grassroots execution. We specialize in sourcing, training, and managing brand representatives to drive measurable results.

$18–$18/hr
India

  • Review pre-seeded questions paired with images to provide accurate golden answers based on visual information. - Carefully examine image content to identify relevant details needed to answer the question. - Maintain consistency and quality across tasks while following project-specific guidelines and rubrics.

Welo Data is an AI services company that provides data annotation and validation solutions for projects like Project Chiron. They are currently seeking detail-oriented freelancers to support their AI data annotation efforts as Urdu Data Trainers.

$1–$1/hr
Ukraine

  • Label faces, heads, and upper bodies in videos to help AI understand visuals.
  • Follow straightforward step-by-step instructions to draw bounding boxes.
  • Work 100% remotely from your home with a reliable computer and internet.

Mindy Support provides data annotation and AI support services. They are a growing company with a remote-first culture.