Design and build rigorous Terminal-Bench tasks to test LLM capabilities in multilingual software engineering and terminal workflows.
Create realistic task environments with datasets and files in your native language to measure multilingual robustness without English translation crutches.
Support reference solutions, write deterministic verifier scripts, and calibrate task difficulty across varied model tiers.
LILT provides AI-powered multilingual translation and language services for enterprises, governments, and AI developers. It is a global community of linguists and software engineers focused on innovation and human-verified AI solutions.
Reviewing Hindi audio clips generated by or for AI models to assess naturalness.
Evaluating how well the AI conveys specific emotions, intonations, and sentiments.
Identifying cultural mismatches or unnatural tones in AI-generated audio.
Prolific builds the largest pool of quality human data globally, serving over 35,000 AI developers and researchers. The company fosters a flexible, remote culture focused on ethical data collection from diverse participants.
You will evaluate search queries and web results for factual accuracy and authority.
You will conduct cross-referencing using regional sources and databases.
You will assess AI-generated content for factual grounding and contextual appropriateness.
TELUS Digital is a global digital solutions company specializing in AI and data services. They are a large organization with a culture focused on quality, innovation, and diversity.
Review, annotate, and validate AI-generated content for linguistic accuracy, naturalness, and cultural relevance.
Identify subtle grammatical issues, awkward phrasing, and cultural inconsistencies in your native language.
Transform quality feedback into structured educational resources to support continuous AI improvement.
Jobgether is an AI-powered recruitment platform that matches candidates with hiring companies through objective and fair review processes. It focuses on remote and freelance roles, leveraging artificial intelligence to shortlist top-fitting candidates.
Evaluate AI-generated German audio in realistic customer service scenarios across travel, finance, and technical support.
Design and execute role-play interactions to assess conversational accuracy, naturalness, and task completion.
Generate structured datasets and feedback that help improve conversational AI performance.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. It uses AI to review applications and promote fair, objective hiring for remote freelance roles.
Evaluate and audit multilingual AI-generated responses for accuracy, helpfulness, and cultural relevance.
Review assigned batches of AI outputs against localized quality guidelines.
Score responses and rank multiple AI-generated answers based on defined quality criteria.
RWS is a language solutions company that provides AI training and linguistic quality evaluation services. They emphasize diversity, equity, and inclusion, offering flexible freelance opportunities for evaluators.
Review, evaluate, and validate AI-generated content and data according to project guidelines.
Identify errors, inconsistencies, omissions, and quality issues in AI outputs.
Provide clear written feedback or justifications for your evaluations.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. It offers limitless flexibility and growth opportunities in a fully remote, autonomous environment.
Follow project-specific guidelines to research and evaluate e-commerce data.
Rate the usefulness and relevance of product filters and results based on guidelines.
Complete freelance tasks remotely with flexible weekly hours and pay based on tasks completed.
Welo Data is a data annotation and evaluation company supporting AI technology advancement through human intelligence and linguistic expertise. It is part of Welocalize's global network of over 400,000 in-country linguistic resources and offers a multicultural, remote-friendly culture.
Audit and evaluate chatbot conversations based on Naturalness/Engagement, Utility, and Audio Quality.
Follow project-specific guidelines to ensure consistent and accurate evaluations using a proprietary platform.
Meet a daily workload of approximately 4 hours per business day for the 2-month project duration.
RWS is a company specializing in language services and AI-driven communication solutions. This project involves freelance linguists collaborating on a temporary contract with flexible hours.
Evaluate AI-generated audio across naturalness, clarity, fidelity and overall quality.
Assign absolute scores and conduct pairwise comparisons in accordance with guidelines.
Write comments to explain any defects found in AI-generated audio.
RWS specializes in technology-enabled language services and AI training data. The company embraces diversity, equity and inclusion, and promotes equal opportunity for all employees.
Design realistic Professional and Technical Services scenarios in Russian or English across operational, legal, financial, and technology contexts.
Adapt structured evaluation rubrics for analytical reasoning, technical problem-solving, project coordination, and professional decision-making.
Review AI and human-generated responses for factual accuracy, professional standards, technical quality, and operational realism.
LILT provides multilingual AI and human-verified services to enterprises, governments, and AI developers, aiming to make the world's information available to everyone. It fosters a global community of linguists and subject matter experts, emphasizing innovation, excellence, and flexible collaboration.
Participate in live video conversations in Japanese with other participants to help train AI models on natural speech patterns.
Discuss everyday topics naturally without scripts, allowing the conversation to flow authentically.
Contribute recorded conversations that are used to teach AI models tone, cultural nuance, and natural language.
Prolific is building the largest pool of quality human data in the world, serving over 35,000 AI developers, researchers, and organizations. They offer a unique platform that connects researchers with a global pool of participants for ethically sourced behavioral data, positioning themselves at the forefront of AI innovation.
Annotate and label text, images, audio, and other content to support AI training and development.
Evaluate search results, advertisements, and chatbot responses for relevance, quality, and usefulness.
Create, review, and test prompts to improve large language models and assess Afrikaans linguistic accuracy.
Jobgether is an AI-powered talent matching platform that connects qualified candidates with hiring companies. It operates a global network of language professionals and remote work opportunities, using automated technology to review applications objectively.
Work on flexible, remote AI training projects in annotation, evaluation, and prompt creation to shape safer, smarter AI.
Contribute to building more accurate, inclusive, and human-centered AI with a global community of linguists and enthusiasts.
Projects vary in scope and complexity, with clear details provided on tasks, timelines, and compensation before you decide to participate.
Welo Data is a global AI data company that delivers high-quality, ethical data to train the world’s most advanced AI systems. With 500,000+ contributors across 100+ countries, they build smarter, more human AI and promise limitless opportunities for contributors to work on their terms.
Debug and resolve issues across complex, multi-file codebases.
Implement new backend or full-stack functionality and refactor existing systems.
Develop and extend unit and integration test suites and review code for correctness.
Anyone AI is an AI lab recruiting experienced Python Software Engineers for paid, project-based engagements. They are a flexible consulting opportunity seeking engineers with strong technical skills for diverse software projects.
Complete side-by-side evaluations of AI-generated Bosnian text to assess naturalness and authenticity.
Rate how natural and idiomatic the writing sounds, identifying unnatural phrasing or cultural mismatches.
Perform quality control and contextual review to ensure tone and register match the cultural context.
Prolific builds the world's largest pool of quality human data for AI. Over 35,000 developers and organizations use Prolific to gather diverse data from paid participants.
Rate and assess AI model outputs based on quality and performance guidelines.
Label content, generate training data, and apply transformations to improve model diversity.
Work remotely on flexible, project-specific tasks with expert-level Turkish and English skills.
Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise to build trusted AI systems. With a 36+ year legacy, they deliver high-quality data and outstanding outcomes for customers.
Record or collect natural, spontaneous speech in Beira Portuguese according to project guidelines.
Participate in real-life conversations or voice-text interactions with AI systems.
Annotate collected speech data and provide required metadata for each recording.
RWS is a global leader in language services and AI data solutions. They are currently hiring for a freelance project to collect speech data for training conversational AI technologies.
Complete AI training tasks such as analyzing, editing, and writing in Cantonese
Judge the performance of AI on Cantonese prompts
Work remotely with flexible hours and earn up to $30/hr
Prolific is building the world's largest pool of quality human data for AI developers and researchers. With over 35,000 organizations using the platform, it connects researchers with diverse participants to improve AI models.