Source Job

20 jobs similar to Labeler / Annotator – AI Response Evaluation (French)

Jobs ranked by similarity.

  • Evaluate AI responses across scenarios like general Q&A and web search results.
  • Perform side-by-side comparisons of AI-generated responses, judging accuracy and clarity.
  • Apply detailed guidelines, maintaining consistency and high-quality evaluations.

Blueprint Technologies is a technology solutions firm that helps organizations grow, transform, and innovate. They have a strong presence across the United States and are expanding across Latin America, with teams united by a shared passion for solving complex problems.

Global

  • Perform side-by-side (SBS) comparisons of AI-generated responses.
  • Evaluate outputs based on accuracy, relevance, clarity, and instruction-following.
  • Apply detailed, scenario-specific annotation guidelines and maintain consistency and high-quality evaluations.

Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and an expanding footprint across Latin America (LATAM). Our people bring diverse perspectives, deep expertise, and real-world experience across industries to help organizations grow, transform, and innovate.

$15–$15/hr
US

  • Identify and label languages and dialects from model-generated responses.
  • Review outputs from two different AI models and determine which model correctly identified the proposed language.
  • Compare model responses and select the appropriate evaluation outcome from predefined options

RWS – TrainAI is looking for Language Data Annotators. They embrace DEI and promotes equal opportunity and prohibits discrimination and harassment of any kind.

Europe

  • Evaluate AI-generated responses for accuracy, grammar, and cultural relevance.
  • Identify issues and provide refined, high-quality rewritten responses.
  • Create natural prompts and responses in French to improve conversational datasets.

Welo Data specializes in AI services. They are launching a language evaluation project.

Europe

  • Review pre-written prompt instructions for tone, grammar, proper name handling, and measurements.
  • Add language-specific grammar or stylistic notes to enhance prompt accuracy.
  • Translate product-specific terms and cross-check against approved glossaries.

Welo Data provides AI services. They focus on AI service general application.

$15–$15/hr
Europe

  • Review pre-written prompt instructions for tone and grammar.
  • Translate product-specific terms and cross-check against glossaries.
  • Run sample attraction descriptions through GPT-4.O, and refine prompts.

Welo Data is an AI services company. We focus on providing Language Specialists to review, refine, and validate AI translation prompts. The company appears to be a community where people can collaborate on exciting projects.

Global

  • Reviewing, annotating, and testing AI outputs for grammatical accuracy.
  • Acting as a primary quality check to proactively identify and correct subtle cultural errors.
  • Analyzing task quality trends and developing educational resources for AI task outputs.

They are sourcing independent Language Alignment & Resource Partners to provide native-level Arabic language vetting and QA for a specialized AI data project. As a contractor, you will supply your own equipment, and company-sponsored benefits do not apply.

$16–$20/hr
Europe

  • Review, refine, and validate AI translation prompts for attraction and travel content.
  • Optimize AI-generated translations to ensure naturalness, fluency, and cultural relevance.
  • Test language prompts to ensure the output meets the required standards.

Welo Data provides AI services. They focus on helping businesses leverage the power of artificial intelligence to improve their operations and create innovative solutions.

  • Review, refine, and validate AI translation prompts for attraction and travel content.
  • Optimize AI-generated translations to meet standards of naturalness and fluency.
  • Test and refine language prompts to ensure output meets cultural relevance.

Welo Data is an AI services company. We are looking for talented people to join our community and contribute to exciting projects related to artificial intelligence.

Global

  • Review English source documents alongside two machine-generated Urdu translations.
  • Evaluate both variants based on accuracy, fluency, and overall translation quality.
  • Select the preferred translation and provide a clear written justification for your assessment.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.

US

  • Interact with generative AI models using project-provided guidelines, safety taxonomies, and attack-vector guidance.
  • Create and evaluate prompts designed to test model behavior across safety-related categories.
  • Identify where model responses become unsafe, noncompliant, inconsistent, or otherwise problematic.

Welo Data is an AI services company that specializes in data annotation. They deliver multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources.

  • Audit and evaluate chatbot conversations based on core dimensions.
  • Follow project-specific guidelines for accurate evaluations.
  • Use a proprietary client platform to complete tasks.

RWS Group provides technology-enabled language, content management and intellectual property services. They embrace DEI and promote equal opportunity; they are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind.

Global

  • Provide linguistic QA and develop alignment resources.
  • Review, annotate, and test AI outputs for grammatical accuracy and cultural context.
  • Analyze task quality trends and develop educational resources to increase alignment.

Project World Wide is focused on AI data projects. They are sourcing for independent contractors.

$20–$20/hr
Europe

  • Review and refine AI translation prompts for attraction and travel content.
  • Optimize AI-generated translations to ensure naturalness and fluency.
  • Identify and flag issues that cannot be resolved through prompt tuning.

Welo Data provides AI services. It's a freelance-remote company that seems to value collaboration and contribution from its community members.

Israel

  • Review and refine AI translation prompts.
  • Ensure output meets standards of naturalness and fluency.
  • Identify and flag issues that cannot be resolved through prompt tuning.

Welo Data is an AI services company. We help businesses leverage AI for their needs, valuing collaboration and innovation.

  • Review and refine AI translation prompts for travel content.
  • Optimize AI-generated translations for naturalness and fluency.
  • Identify and flag issues that cannot be resolved through prompt tuning.

Welo Data offers AI services. They are looking for language specialists.

$12–$12/hr
Global

  • Review, refine, and validate AI translation prompts for attraction and travel content.
  • Optimize AI-generated translations, ensuring naturalness, fluency, and cultural relevance.
  • Review pre-written prompt instructions for tone, grammar, and proper name handling.

Welo Data is an AI services company. They focus on providing AI solutions to various industries.

US

  • Support the evaluation and labeling of images, search queries and other forms of data.
  • Understand challenging guidelines and articulate understanding.
  • Help LLMs learn the intricacies of language and reasoning.

Innodata is a global data engineering company that believes data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale.

$28–$28/hr
US

  • Review, refine, and validate AI translation prompts for attraction and travel content.
  • Optimize AI-generated translations to meet standards of naturalness and fluency.
  • Proofread bilingual descriptions for accuracy and readability, refining prompts as needed.

Welo Data provides AI services. We have an exciting community and are looking for collaborators.

US

  • Interact with generative AI models and project guidelines.
  • Create prompts to test model behavior across safety categories.
  • Document model breakability and effort level.

Welo Data provides AI services and specializes in data annotation. We foster a collaborative and innovative culture where employees contribute to cutting-edge AI safety evaluation.