Design complex evaluation frameworks and execute role-play scenarios simulating realistic customer service interactions.
Audit AI model performance across standardized metrics, focusing on task completion, conversational naturalness, and audio comprehension.
Generate diverse, high-quality audio datasets and assess basic computer programming literacy in JSON and structured data reasoning.
The company is an AI benchmarking project that evaluates advanced agentic audio models through simulated customer support scenarios. It is a freelance contractor project with no specific company size or culture mentioned beyond the project scope.
Evaluate social media ads for relevance, accuracy, and appropriateness using an external platform.
Commit to one hour daily, five days a week, assessing ads on a personal computer.
Share insights on ad preferences to improve online advertising strategies.
CrowdGen by Appen connects businesses with a global network of independent contractors to improve AI and digital content. As a large platform, it focuses on flexible, project-based opportunities for remote contributors.
Review and grade internet advertisements to help shape how ads are delivered to end users.
Tell the AI program how good or bad its advertisement suggestions are based on user keywords.
Work in both Italian and English with a flexible schedule of 5 to 20 hours per week.
Welo Data is an award-winning localization and data transformation company that runs one of the world’s largest Ads Rating Programs. They offer a flexible, self-paced work environment for independent contractors.
Review, evaluate, and annotate AI-generated content across text, images, audio, and video.
Perform quality checks to ensure accuracy, consistency, and compliance with guidelines.
Identify edge cases and contribute to high-quality datasets for training advanced AI models.
Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors delivering high-quality, ethical data to train advanced AI systems. They foster a diverse community across 100+ countries and offer flexible, project-based opportunities with complete autonomy.
Review online ads and provide human feedback to improve ad quality and relevance.
Evaluate ad matching, language accuracy, and cultural relevance for German-speaking markets.
Contribute your human perspective to AI training, working at your own pace.
TELUS Digital enhances AI via human intelligence by providing enriched data through a skilled team of AI specialists and a managed AI community of over one million crowd contributors. They maintain a diverse international culture and support remote work with flexible hours.
Design and execute complex role-play evaluation scenarios simulating real customer support interactions in domains like travel and finance.
Evaluate AI-generated audio outputs using structured qualitative and quantitative metrics, focusing on accuracy, fluency, and task completion.
Audit conversational performance and contribute to the creation and refinement of high-quality, representative audio datasets.
Our partner company specializes in AI training and evaluation for conversational models, focusing on audio quality and real-world scenarios. As a freelance platform, they offer flexible remote work opportunities to language and evaluation specialists.
Review and evaluate AI-generated content across text, images, audio, and video.
Perform quality checks to ensure accuracy, consistency, and compliance with project guidelines.
Identify edge cases and contribute to high-quality dataset development.
Welo Data is a global AI data company that provides high-quality, ethical data to train advanced AI systems. It has over 500,000 contributors worldwide and offers flexible, project-based opportunities with a focus on community and growth.
Transcribe 5-second audio clips of English dialects accurately according to style guide.
Flag audio issues such as background noise or cut-off speech using simple codes.
Work flexible hours with an average completion time of ~125 seconds per task.
Welo Data, part of Welocalize, is a global AI data company that delivers high-quality, ethical data to train the world’s most advanced AI systems. With over 500,000 contributors in 100+ countries, the company values diversity and community.
Conduct second-pass quality reviews to ensure linguistic accuracy and consistency across batches.
Validate severity assessments and identify systemic MT quality issues such as recurring error patterns.
Provide high-level qualitative feedback to support final quality reporting and continuous improvement.
Welo Data provides AI services, focusing on language and data solutions for machine learning. They operate as a flexible, freelance-based organization with ongoing project needs.
Rate the performance of AI models or algorithms based on their output or behavior.
Label elements of content, assign categories, and evaluate quality or appropriateness.
Generate additional training data by transforming original data like text, images, or audio.
Innodata is a global data engineering company enabling responsible AI advancement. With over 36 years of experience, we deliver high-quality data and services to AI builders and adopters.
Annotate or label text, images, or audio to train AI systems
Evaluate search results, ads, or chatbot responses for quality and relevance
Create and test prompts to improve large language models (LLMs)
Welo Data is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They are building smarter, more human AI with a diverse community in over 100 countries.
Label, annotate, and evaluate photos, graphics, and videos in Thai for linguistic and cultural accuracy.
Evaluate AI-generated content against quality standards for Thai users.
Build Thailand-specific datasets to support internationalization of AI features.
Canva is redefining how the world experiences design by providing a visual communication platform. As a global company with international users representing almost 60% of its user base, it fosters a fast-paced, collaborative culture across worldwide teams.
Use deep knowledge of English grammar, syntax, semantics, phonetics, and pragmatics to challenge and improve AI language models.
Interact with AI models daily on language scenarios, document error traces, and suggest improvements for prompt engineering and evaluation.
Work remotely as a contractor, contributing to high-quality training data that powers next-generation AI systems.
Inito is a company that specializes in training AI language models using linguistic expertise. The company operates with a remote contractor model and seeks experts for project-based work.
Evaluate AI-generated Tamil audio for natural emotional and cultural nuance.
Perform sentiment analysis to assess model’s conveyance of intonations and feelings.
Identify and report unnatural or culturally mismatched tones in AI output.
Prolific builds the biggest pool of quality human data in the world, connecting researchers with over 35,000 paid study participants. It is a platform that enables the collection of high-quality, ethically sourced human behavioral data for AI development.
Review and update client data accurately based on provided Style Guides.
Research and validate information using internal and external data sources.
Resolve data discrepancies and merge duplicate records.
Harbor provides expert services in strategy, legal technology, operations, and intelligence. With a globally integrated team of over 900 strategists, technologists, and specialists, they serve leading law firms and corporations, fostering a culture of deep knowledge and mutual respect.
Review, evaluate, and annotate AI-generated content across text, images, audio, and video.
Perform quality checks to ensure accuracy, consistency, and compliance with project guidelines.
Identify edge cases and contribute to the development of high-quality datasets used to train advanced AI models.
Welo Data is a global AI data company that provides high-quality, ethical data to train advanced AI systems. They have over 500,000 contributors worldwide and emphasize limitless growth and support for their community of freelancers.
Evaluate podcasts in German, focusing on metadata accuracy, explicit content tagging, rights infringement checks, and artwork design quality.
Work about 20 hours per month with flexible scheduling.
Requires a functional MacBook/Mac device.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train AI systems. We’re building smarter AI with a diverse community in 100+ countries.
Read and record short sentences in English at varying volume levels (normal, soft, and whisper).
Complete all recordings within a single session.
Follow project guidelines to ensure recordings meet quality standards.
Appen is a company that collects and annotates data for AI and machine learning projects. They work with a large global crowd of independent contractors to improve AI systems.
Review English source documents alongside two machine-generated Assamese translations, evaluating accuracy, fluency, and overall quality.
Select the preferred translation and provide a clear written justification for your assessment.
Complete assigned samples independently within established timelines, adhering strictly to project and client guidelines.
Welo Data provides AI operations and data generation services for leading technology clients. They are a global contributor community offering project-based opportunities with flexible, remote work.