Perform sampling and quality checks on annotated datasets to ensure adherence to annotation guidelines
Identify, log, and categorize annotation defects with severity levels, tracking corrective actions and rework tasks
Coordinate onboarding training, calibration sessions, and refresher training for annotators and reviewers
Welo Data is a multilingual data and evaluation partner for foundation labs and enterprises deploying GenAI systems globally, delivering human judgment, data infrastructure, and evaluation systems for reliable AI performance across languages and cultures. It operates with a global network of over 500,000 vetted experts across 300+ languages, leveraging a unified model led by specialized experts with proprietary identity and fraud-prevention frameworks to ensure accurate and culturally grounded datasets.
Support the evaluation and labeling of images, search queries and other forms of data.
Understand challenging guidelines and articulate understanding.
Help LLMs learn the intricacies of language and reasoning.
Innodata is a global data engineering company that believes data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale.
Identify and label languages and dialects from model-generated responses.
Review outputs from two different AI models and determine which model correctly identified the proposed language.
Compare model responses and select the appropriate evaluation outcome from predefined options
RWS – TrainAI is looking for Language Data Annotators. They embrace DEI and promotes equal opportunity and prohibits discrimination and harassment of any kind.
Manage delivery of software and AI-enabled projects under guidance of senior project managers.
Maintain project plans, schedules, RAID logs, and delivery documentation.
Track project progress, risks, and dependencies and escalate as needed.
NICE Ltd. software products are used by 25,000+ global businesses to deliver extraordinary customer experiences, fight financial crime and ensure public safety. With over 8,500 employees across 30+ countries, NICE is consistently recognized as the market leader in its domains, excelling in AI, cloud and digital.
Perform annotation and labeling tasks for generative AI datasets, including text, image, video, and multimodal content.
Create, review, and evaluate prompts and responses across a variety of domains and use cases.
Conduct quality assurance reviews to ensure annotation accuracy, consistency, and adherence to guidelines.
Welo Data delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages. They drive innovation in language services, delivering high-quality training data transformation solutions for NLP-enabled machine learning, with a network of over 400,000 in-country linguistic resources.
Lead, train, and manage our in-house data labeling team.
Define, execute, and continuously improve data annotation processes with a very high attention to detail.
Ensure high-quality data outputs and meet rigorous accuracy and consistency standards.
Reducto provides a complete toolkit for handling any workflow by understanding documents the way a human would. They have raised over $100M and partner with hundreds of companies, from leading AI teams to enterprise costumers across FAANG and top trading firms.
Interact with generative AI models and project guidelines.
Create prompts to test model behavior across safety categories.
Document model breakability and effort level.
Welo Data provides AI services and specializes in data annotation. We foster a collaborative and innovative culture where employees contribute to cutting-edge AI safety evaluation.
Interact with generative AI models using project-provided guidelines, safety taxonomies, and attack-vector guidance.
Create and evaluate prompts designed to test model behavior across safety-related categories.
Identify where model responses become unsafe, noncompliant, inconsistent, or otherwise problematic.
Welo Data is an AI services company that specializes in data annotation. They deliver multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources.
Steward the end-to-end planning, execution, and delivery of the dataset development program.
Act as the primary liaison between ML engineers, GIS engineers, technical artists, product stakeholders, and external annotation vendors.
Manage vendor relationships, including onboarding, quality assurance, throughput tracking, and contract compliance.
NBCUniversal is a leading media and entertainment company that creates world-class content across film, television, and streaming, with global theme park destinations, consumer products, and experiences. They own brands like NBC, NBC News, and Peacock and operate industry-leading theme parks worldwide. We champion an inclusive culture and strive to attract and develop a talented workforce.
Evaluate outputs based on accuracy, relevance, clarity, and instruction-following.
Perform side-by-side (SBS) comparisons of AI-generated responses.
Identify nuances in tone, meaning, and cultural context across French.
Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and an expanding footprint across Latin America (LATAM). They are united by a shared passion for solving complex problems and bring diverse perspectives, deep expertise, and real-world experience across industries to help organizations grow, transform, and innovate.