Source Job

  • Interact with AI models across a wide range of prompts and topics.
  • Compare AI-generated responses side by side to assess quality.
  • Write clear, well-reasoned explanations supporting your evaluations.

English LLM Critical Thinking Attention To Detail

20 jobs similar to Quality Evaluator – English

Jobs ranked by similarity.

Global

  • Evaluate AI-generated customer service responses and technical content for clarity, helpfulness, and accuracy.
  • Validate and troubleshoot JSON structure and formatting against project guidelines.
  • Provide clear written feedback explaining your reasoning for each evaluation.

Anyone AI creates high-quality training and evaluation data for frontier AI models. This is a part-time, remote contractor opportunity focused on improving AI outputs through expert human evaluation.

US

  • Evaluate AI-generated content in Malayalam for linguistic accuracy and cultural relevance.
  • Translate prompts from English to Malayalam and interact with an AI assistant.
  • Provide structured evaluations and feedback following project quality guidelines.

RWS is a global leader in language services and technology, providing translation, localization, and AI training solutions. The company values innovation, quality, and cultural expertise, offering flexible freelance opportunities for language professionals.

$18–$18/hr
US

  • Evaluate AI-generated content in Marathi for linguistic accuracy and cultural relevance.
  • Translate prompts from English into Marathi and interact with an AI assistant.
  • Provide structured quality assessments following project guidelines.

RWS is a global leader in technology-enabled language services, helping organizations deliver multilingual content and train next-generation AI. This project-based freelance role with RWS TrainAI offers flexible remote work and collaboration with a diverse team of language experts.

Australia

  • Evaluate AI-generated responses for relevance, accuracy, and personalization using personalized prompts and data from connected Google applications.
  • Identify subtle issues such as incorrect assumptions, irrelevant recommendations, inconsistencies, and inappropriate personalization.
  • Provide clear, detailed, and structured feedback to support improvements to AI models and personalization systems.

Our partner company is seeking an AI Response Quality Evaluator to improve AI-generated responses. This is a project-based contract role with a remote, independent working environment and a duration of up to 16 weeks.

New Zealand

  • Evaluate conversations between users and AI voice agents by listening to recorded interactions.
  • Rate each AI agent turn on two 1-5 scales: content quality and prosody naturalness.
  • Provide clear, specific written justifications for each rating given.

Welo Data provides AI services, specializing in data evaluation and human feedback for AI systems. They are an established company with a global community of freelancers and a focus on remote, collaborative work.

$18–$18/hr
US

  • Evaluate AI-generated content in Telugu for linguistic accuracy and naturalness.
  • Translate prompts from English to Telugu and interact with an AI assistant.
  • Provide structured feedback on localization quality and cultural appropriateness.

RWS is a language solutions company that helps improve AI applications through linguistic evaluation. This project is a short-term freelance collaboration with flexible remote work from the United States.

AI Engineer

Elicit
$185,000–$320,000/yr
US 4w PTO

  • Build evaluations to measure and improve AI reasoning in complex, high-stakes decisions.
  • Collaborate with engineers, product, and domain experts to turn observed failures into testable improvements.
  • Own the quality of shipped systems, from code reviews to monitoring and integration.

Elicit builds AI systems that help research and business teams make evidence-based decisions on high-stakes questions. They are a remote-friendly, collaborative team that values rigorous thinking, experimentation, and in-person retreats.

Global

  • Rate and assess AI model outputs based on quality and performance guidelines.
  • Label content, generate training data, and apply transformations to improve model diversity.
  • Work remotely on flexible, project-specific tasks with expert-level Turkish and English skills.

Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise to build trusted AI systems. With a 36+ year legacy, they deliver high-quality data and outstanding outcomes for customers.

Europe

  • Annotate and label text, images, audio, or other content for AI training projects.
  • Evaluate AI-generated content for quality, relevance, accuracy, and overall usefulness.
  • Create, review, and test prompts to improve large language model performance.

AI Trainers Network is a global AI contributor network that shapes smarter and more human-centered AI through language and cultural expertise. It connects a diverse international community of independent contributors working on flexible, remote AI training projects.

$30–$60/hr
Global

  • Design realistic legal tasks based on professional legal research, contract analysis, litigation support, and regulatory review workflows.
  • Analyze contracts, statutes, regulations, and case law to develop evaluation criteria for AI agents.
  • Review AI-generated legal analyses for accuracy, completeness, jurisdictional relevance, and logical consistency.

Anyone AI creates high-quality training and evaluation data for frontier AI models. They provide contract opportunities for experts to contribute to AI development.

US

  • Evaluate conversations between users and AI voice agents for content quality and prosody.
  • Rate each AI agent turn on a 1–5 scale and provide written justification.
  • Maintain consistent, well-reasoned ratings with strong attention to detail.

Welo Data provides AI services, specializing in data annotation and evaluation for machine learning models. As a global company, they offer freelance opportunities for detail-oriented contractors to support AI development projects.

UK

  • Listen to recorded conversations between users and AI voice agents to evaluate response quality.
  • Rate each agent turn on two scales: content helpfulness and prosody naturalness.
  • Write short, specific justifications for each score given.

Welo Data is an AI services company that provides evaluation and data services for AI voice agents. They are a global organization with a freelance workforce, focusing on quality assessment of AI interactions.

Canada

  • Listen carefully to recorded conversations between a person and an AI voice agent.
  • Rate each agent turn on two 1–5 scales: Content (helpfulness/relevance) and Prosody (naturalness/expressiveness).
  • Write short, specific justifications for each score given.

Welo Data provides AI services, specializing in evaluating and improving AI voice agents through detailed audio rating. As a growing community of freelancers, they emphasize attention to detail and clear communication for project-based work.

Australia Ireland New Zealand UK United States Canada

  • Create and answer questions to train AI models.
  • Review, analyze, and rank AI-models' chains of thought for correctness and approach.
  • Provide clear, constructive feedback to improve AI-generated responses.

This enterprise client partners with innovative companies to improve their AI models. They offer flexible, remote work for English speakers, with no AI or technical background required.

Global

  • Design realistic healthcare and medical tasks that challenge advanced AI agents.
  • Analyze clinical records, research findings, and healthcare data to identify inconsistencies and errors.
  • Develop reference solutions and evaluation criteria for AI-generated medical analyses.

Anyone AI creates high-quality training and evaluation data for frontier AI models. The company offers flexible, remote contract work focused on expert-driven AI evaluation and improvement.

Spain

  • Evaluate search results and AI-generated content for quality, relevance, accuracy, and usefulness.
  • Conduct online research to verify information and support rating decisions.
  • Participate in training, calibration sessions, and ongoing quality reviews.

TELUS Digital is a global AI community that helps customers collect, enhance, train, translate, and localize content to build better AI models. It consists of a vibrant network of over 1 million contributors from diverse backgrounds.

Ireland

  • Annotate and label text, images, audio, or other content to support AI model training.
  • Evaluate AI-generated outputs such as search results and chatbot responses for quality and relevance.
  • Create and refine prompts while reviewing Greek linguistic and cultural accuracy.

This opportunity is a talent network for Greek-speaking contributors supporting AI model training through annotation, evaluation, and prompt creation. It is a global, remote community of independent contributors with flexible project-based work.

Poland

  • Annotate and label text, images, or audio to train and improve AI models.
  • Evaluate search results, chatbot responses, and AI-generated content for accuracy and relevance.
  • Create and refine prompts and review AI outputs for linguistic and cultural appropriateness.

AI Trainers Network connects language professionals with projects that improve AI accuracy, relevance, and inclusivity. It is a global, flexible remote network offering project-based opportunities and transparent compensation.

Global

  • Collect data according to detailed project guidelines and specifications.
  • Ensure collected data meets the project's required standards and apply feedback for corrections.
  • Maintain consistent quality and productivity throughout the project.

Our enterprise client is a leading provider of high-quality, diverse datasets for AI model development. They are seeking skilled contributors to support AI training initiatives focused on improving AI-powered language and speech models.

Global

  • Record short, one-sided phone calls in French using your iPhone to help train voice AI.
  • Follow a simple 6-step call flow and pause where the agent would respond; use only fake personal details.
  • Earn $3.70 per approved session, with payouts from $14.80 up to $37 for completing 4–10 sessions.

CrowdGen by Appen runs AI training projects that improve voice and language models. You'll join a global community of independent contractors working on flexible, remote tasks.