Evaluate outputs based on accuracy, relevance, clarity, and instruction-following.
Perform side-by-side (SBS) comparisons of AI-generated responses.
Identify nuances in tone, meaning, and cultural context across French.
Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and an expanding footprint across Latin America (LATAM). They are united by a shared passion for solving complex problems and bring diverse perspectives, deep expertise, and real-world experience across industries to help organizations grow, transform, and innovate.
Evaluate AI responses across scenarios like general Q&A and web search results.
Perform side-by-side comparisons of AI-generated responses, judging accuracy and clarity.
Apply detailed guidelines, maintaining consistency and high-quality evaluations.
Blueprint Technologies is a technology solutions firm that helps organizations grow, transform, and innovate. They have a strong presence across the United States and are expanding across Latin America, with teams united by a shared passion for solving complex problems.
Identify and label languages and dialects from model-generated responses.
Review outputs from two different AI models and determine which model correctly identified the proposed language.
Compare model responses and select the appropriate evaluation outcome from predefined options
RWS – TrainAI is looking for Language Data Annotators. They embrace DEI and promotes equal opportunity and prohibits discrimination and harassment of any kind.
Review, refine, and validate AI translation prompts for attraction and travel content.
Optimize AI-generated translations to ensure naturalness, fluency, and cultural relevance.
Test language prompts to ensure the output meets the required standards.
Welo Data provides AI services. They focus on helping businesses leverage the power of artificial intelligence to improve their operations and create innovative solutions.
Interact with generative AI models using project-provided guidelines, safety taxonomies, and attack-vector guidance.
Create and evaluate prompts designed to test model behavior across safety-related categories.
Identify where model responses become unsafe, noncompliant, inconsistent, or otherwise problematic.
Welo Data is an AI services company that specializes in data annotation. They deliver multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources.
Audit and evaluate chatbot conversations based on core dimensions.
Follow project-specific guidelines for accurate evaluations.
Use a proprietary client platform to complete tasks.
RWS Group provides technology-enabled language, content management and intellectual property services. They embrace DEI and promote equal opportunity; they are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind.
Interact with generative AI models and project guidelines.
Create prompts to test model behavior across safety categories.
Document model breakability and effort level.
Welo Data provides AI services and specializes in data annotation. We foster a collaborative and innovative culture where employees contribute to cutting-edge AI safety evaluation.
Review pre-written prompt instructions for tone and grammar.
Translate product-specific terms and cross-check against glossaries.
Run sample attraction descriptions through GPT-4.O, and refine prompts.
Welo Data is an AI services company. We focus on providing Language Specialists to review, refine, and validate AI translation prompts. The company appears to be a community where people can collaborate on exciting projects.
Review English source documents alongside two machine-generated Urdu translations.
Evaluate both variants based on accuracy, fluency, and overall translation quality.
Select the preferred translation and provide a clear written justification for your assessment.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.
Support the evaluation and labeling of images, search queries and other forms of data.
Understand challenging guidelines and articulate understanding.
Help LLMs learn the intricacies of language and reasoning.
Innodata is a global data engineering company that believes data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale.
Review, refine, and validate AI translation prompts for attraction and travel content.
Optimize AI-generated translations to meet standards of naturalness and fluency.
Test and refine language prompts to ensure output meets cultural relevance.
Welo Data is an AI services company. We are looking for talented people to join our community and contribute to exciting projects related to artificial intelligence.
Engage in conversations with a real-time speech-to-speech AI model.
Evaluate performance based on speech recognition, audio quality, conversation flow, and content accuracy.
Provide accurate and consistent ratings based on project guidelines.
Appen is a company that focuses on improving real-time conversational AI. They leverage independent contractors and project-based opportunities to enhance multilingual voice interactions. They seem to foster a community-driven environment.
Reviewing, annotating, and testing AI outputs for grammatical accuracy.
Acting as a primary quality check to proactively identify and correct subtle cultural errors.
Analyzing task quality trends and developing educational resources for AI task outputs.
They are sourcing independent Language Alignment & Resource Partners to provide native-level Arabic language vetting and QA for a specialized AI data project. As a contractor, you will supply your own equipment, and company-sponsored benefits do not apply.