Rate the performance of AI models or algorithms based on their output or behavior.
Label elements of content, assign categories, and evaluate quality or appropriateness.
Generate additional training data by transforming original data like text, images, or audio.
Innodata is a global data engineering company enabling responsible AI advancement. With over 36 years of experience, we deliver high-quality data and services to AI builders and adopters.
Annotate or label text, images, or audio to train AI systems
Evaluate search results, ads, or chatbot responses for quality and relevance
Create and test prompts to improve large language models (LLMs)
Welo Data is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They are building smarter, more human AI with a diverse community in over 100 countries.
Use deep knowledge of English grammar, syntax, semantics, phonetics, and pragmatics to challenge and improve AI language models.
Interact with AI models daily on language scenarios, document error traces, and suggest improvements for prompt engineering and evaluation.
Work remotely as a contractor, contributing to high-quality training data that powers next-generation AI systems.
Inito is a company that specializes in training AI language models using linguistic expertise. The company operates with a remote contractor model and seeks experts for project-based work.
Evaluate search results and AI-generated content for quality, relevance, accuracy, and usefulness.
Apply rating guidelines consistently while maintaining high quality standards and meeting productivity expectations.
Participate in training, calibration sessions, and ongoing quality reviews to improve AI model performance.
TELUS Digital enriches data for better AI via human intelligence. They empower generative AI, computer vision, and NLP models with a skilled team and a managed AI community of over one million contributors.
Create and curate an evaluation suite of real-world tasks for frontier AI models.
Rigorously evaluate AI systems, analyze results, and communicate findings.
Improve evaluation processes and potentially build out standalone benchmarks.
Epoch AI is a research institute that investigates trends in machine learning and the economic consequences of AI. Our mission is to develop a comprehensive, publicly accessible knowledge base on AI that informs policymakers, industry leaders, and society at large.
Contribute to AI training by ranking responses or providing creative prompts.
Participate in behavioral experiments, user research, and academic studies.
Complete surveys, interviews, and feedback sessions on various topics.
Prolific builds the world's largest pool of quality human data, serving over 35,000 AI developers and researchers. A fast-growing company, it fosters a culture of innovation and diversity, connecting participants with academic and applied research studies.
Evaluate AI-generated Telugu text for linguistic accuracy, grammar, and cultural relevance.
Rewrite and improve language outputs with natural prompts and responses.
Collaborate with global teams to enhance conversational AI model quality.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They have a diverse community in 100+ countries and offer project-based opportunities with full remote autonomy.
Review and assess new AI benchmarks at least every two weeks, evaluating their methodology and implications.
Publish and maintain public-facing reports on benchmarks, updating them as versions and models evolve.
Examine individual tasks within benchmarks in detail, using coding agents while maintaining critical oversight.
Epoch AI is a research institute investigating trends in machine learning and the economic consequences of AI. We aim to build a comprehensive knowledge base on AI, serving policymakers and society, with a small, focused team that values rigor and inclusivity.
Apply deep knowledge of Taiwanese grammar, syntax, and morphology to challenge and refine advanced language models.
Document model failure modes in areas like verb conjugation, case systems, and stylistic variation to improve AI reasoning.
Collaborate on prompt engineering and evaluation metrics through precise, metacognitive communication.
Greenhouse powers the next generation of AI by leveraging language expertise to train advanced models. They operate as a freelance contractor platform seeking specialized language professionals for AI training projects.
Contribute to training smarter, more inclusive AI through flexible, remote projects.
Work on annotation, evaluation, and prompt creation tasks tailored to your skills.
Join a global community of linguists and culturally aware contributors shaping safer AI.
Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors delivering high-quality, ethical data to train advanced AI systems. We are building a diverse community in 100+ countries, offering limitless opportunities for growth and contribution on your own terms.
Design, build, and deploy AI-powered product features leveraging LLMs to enhance user workflows.
Develop and maintain evaluation frameworks, guardrails, and monitoring systems for AI reliability.
Collaborate with cross-functional teams to integrate generative AI into backend services and APIs.
This company provides a modern SaaS platform that helps organizations strengthen security, compliance, and trust. They have a remote-first environment with a strong engineering culture focused on ownership and collaboration.
Evaluate AI responses using a structured rating guide.
Translate prompts and evaluations into English.
CrowdGen by Appen provides AI training data services to improve machine learning models. They operate a global community of independent contractors and emphasize flexible, remote work.
Evaluate AI-generated text and voice snippets in Punjabi for naturalness and authenticity.
Assess audio clips for cultural and tonal accuracy of AI speech.
Provide feedback on linguistic nuance and quality of AI outputs.
Prolific builds the biggest pool of quality human data in the world, serving over 35,000 AI developers and researchers. The company connects researchers with paid study participants from diverse backgrounds to gather high-quality, ethically sourced behavioral data.
Design complex evaluation frameworks and execute role-play scenarios simulating realistic customer service interactions.
Audit AI model performance across standardized metrics, focusing on task completion, conversational naturalness, and audio comprehension.
Generate diverse, high-quality audio datasets and assess basic computer programming literacy in JSON and structured data reasoning.
The company is an AI benchmarking project that evaluates advanced agentic audio models through simulated customer support scenarios. It is a freelance contractor project with no specific company size or culture mentioned beyond the project scope.
Review, evaluate, and annotate AI-generated content across text, images, audio, and video.
Perform quality checks to ensure accuracy, consistency, and compliance with project guidelines.
Identify edge cases and contribute to the development of high-quality datasets used to train advanced AI models.
Welo Data is a global AI data company that provides high-quality, ethical data to train advanced AI systems. They have over 500,000 contributors worldwide and emphasize limitless growth and support for their community of freelancers.
Design and execute complex role-play evaluation scenarios simulating real customer support interactions in domains like travel and finance.
Evaluate AI-generated audio outputs using structured qualitative and quantitative metrics, focusing on accuracy, fluency, and task completion.
Audit conversational performance and contribute to the creation and refinement of high-quality, representative audio datasets.
Our partner company specializes in AI training and evaluation for conversational models, focusing on audio quality and real-world scenarios. As a freelance platform, they offer flexible remote work opportunities to language and evaluation specialists.
Review and critically evaluate new AI benchmarks on a regular cadence.
Produce clear, publication-ready research reports for broad audiences.
Analyze benchmark datasets using coding tools while maintaining analytical oversight.
The company focuses on producing rigorous, public-facing evaluations of AI benchmarks. It is a remote-first organization with a collaborative culture that values critical thinking and independence.
Write prompts in Luxembourgish to test AI models and evaluate responses using a structured rating guide.
Identify areas for improvement in AI responses and provide accurate English translations.
Work remotely on a flexible schedule with competitive pay.
CrowdGen by Appen is a platform that connects freelancers to help improve AI models through data annotation and evaluation. It is part of a large global company with a diverse community of independent contractors working remotely.
Engage in natural conversations with two AI models and evaluate their performances.
Compare and rank models based on provided criteria after each dialogue.
Submit pass/fail votes for each model to help improve AI quality.
An enterprise client helps innovative companies improve their AI models through human feedback. They are seeking a high volume of freelancers for conversational AI training tasks.
Develop compelling, compliant grant proposals and supporting documents, using AI tools for research and drafting.
Manage the grant application process, coordinating with clients and ensuring deadlines are met.
Communicate effectively with clients, provide updates, and maintain accurate records of all submissions.
Zero To One Strategic is a specialized consultancy that helps clients maximize revenues from Canadian R&D and Innovation programs. They work with businesses across various sectors, providing expert guidance on securing non-dilutive funding through grants, subsidies, and tax credits.