Review text or media samples based on provided project guidelines
Apply accurate labels and categorizations to diverse data sets
Evaluate AI-generated responses for clarity, safety, and factual accuracy
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Design realistic healthcare and medical tasks that challenge advanced AI agents.
Analyze clinical records, research findings, and healthcare data to identify inconsistencies and errors.
Develop reference solutions and evaluation criteria for AI-generated medical analyses.
Anyone AI creates high-quality training and evaluation data for frontier AI models. The company offers flexible, remote contract work focused on expert-driven AI evaluation and improvement.
Create original graduate- and PhD-level problems within your STEM expertise.
Develop rigorous, step-by-step solutions and review AI-generated responses for accuracy.
Work fully asynchronously through an online platform to contribute to AI reasoning research.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. They use technology to streamline recruitment and are part of a network of partner companies.
Build the Learning Gym, a sandboxed environment for training and evaluating AI agents on real Niural workflows with ground-truth reward signals.
Engineer verifiers, run reinforcement learning loops, and establish honest baselines to prove agent improvements generalize.
Write first-author research papers and internal technical reports, and represent the work externally through preprints and talks.
Niural is a global payroll, Employer of Record (EOR), Agent of Record (AOR), and Contractor Management platform. It is a relentlessly ambitious team focused on building foundational internet infrastructure for the AI era.
Design realistic legal tasks based on professional legal research, contract analysis, litigation support, and regulatory review workflows.
Analyze contracts, statutes, regulations, and case law to develop evaluation criteria for AI agents.
Review AI-generated legal analyses for accuracy, completeness, jurisdictional relevance, and logical consistency.
Anyone AI creates high-quality training and evaluation data for frontier AI models. They provide contract opportunities for experts to contribute to AI development.
Build and ship AI methods for federal research data with LLMs, NLP, RAG, knowledge graphs.
Benchmark AI against baselines and human reviewers to prove gains in accuracy, reliability, efficiency, cost.
Set standards for trustworthy AI and mentor data scientists through code review and guidance.
ARI builds AI methods for federal research-funding and administrative data, with clients including the NIH. It is a small multidisciplinary team of scientists, analysts, economists, and data scientists experienced with NIH data.
Design realistic electrical engineering tasks based on electronics development, circuit analysis, and electrical systems design.
Create and validate electrical schematics, PCB layouts, and technical specifications for AI evaluation.
Review AI-generated designs for technical accuracy and establish reference solutions.
We create high-quality training and evaluation data for frontier AI models. We are a flexible, remote-first organization assembling a team of expert contractors to advance AI systems.
Run open-ended research projects using the internet as the primary tool.
Turn messy findings into clean outputs: matrices, briefs, landscape maps.
Use AI tools aggressively and build lightweight tools when needed.
A private design studio building and supporting a portfolio of companies across software, hardware, hospitality, and more. An affiliate of Expa, it also runs an early-stage investment fund and a founder cohort program.
Provide news and competitive intelligence monitoring for pharmaceutical and life-sciences clients.
Conduct clinical trial research and maintain organized records of active programs.
Support database and AI-assisted research workflows using AlphaSense, GlobalData, and AI tools.
20four7VA connects offshore independent contractors with clients worldwide to deliver remote business support services. They foster a vibrant community with constant support and guidance for contractors.
Review, analyze, and rank AI-models' chains of thought for correctness and approach.
Provide clear, constructive feedback to improve AI-generated responses.
This enterprise client partners with innovative companies to improve their AI models. They offer flexible, remote work for English speakers, with no AI or technical background required.
Participate in AI training, behavioral experiments, user research, and academic studies from home.
Respond thoughtfully to tasks like ranking AI responses, surveys, and one-on-one interviews.
Earn competitive pay with flexible hours while influencing future AI systems.
Prolific connects AI developers and researchers with a global pool of paid study participants to gather high-quality, ethically sourced human data. Over 35,000 organizations use the platform, and the company values diverse human perspectives to drive AI innovation.
Build production Agentforce agents including topics, actions, grounding, guardrails, and evaluation harnesses.
Implement actions across Flow, Apex, prompt templates, and external APIs, grounding answers in Data 360.
Design guardrails against prompt injection and data leakage, and run evaluation and regression tests before changes.
AspenView Technology Partners builds high-performing nearshore IT teams for North American clients, focusing on innovation and efficiency. They are a people-first, purpose-driven company that believes great culture drives great outcomes.
Build tools for understanding traces, evaluating agent behavior, and turning results into improvements.
Run experiments on Mastra's primitives to find where they fall short and improve configuration and behavior.
Help turn findings into capabilities developers can use in their own applications.
Mastra is the open-source TypeScript framework for building AI agents. We're a small, fully remote team backed by Y Combinator and Spark Capital with $35M raised.
Evaluate software engineering tasks for technical accuracy, realism, and reproducibility.
Investigate codebases, tests, and integration issues to identify technical weaknesses.
Provide clear, actionable feedback that directly improves AI training and evaluation workflows.
Jobgether is an AI-powered job platform that connects candidates to roles through objective, skill-based matching. It focuses on remote and freelance opportunities, with a data-driven recruitment process and a global candidate pool.
Audit AI 'Chain-of-Thought' reasoning for medical diagnostics to ensure adherence to international clinical protocols.
Rigorously verify AI-generated drug interactions, dosage recommendations, and contraindications against peer-reviewed medical literature.
Precisely label complex biomedical datasets—including MRI/CT scans, pathology reports, and genomic data—to improve model visual-spatial reasoning.
TELUS Digital is a technology company that helps businesses collect, enhance, train, translate, and localize content to build better AI models. They have a global AI community of over one million contributors from diverse backgrounds, fostering a culture of flexibility and innovation.
Define and drive the design vision for our AI-native enterprise readiness platform.
Lead and scale UX, product design, and design research functions.
Partner with Product, Engineering, and Data to deliver intuitive, mission-critical experiences.
Air provides an AI-native platform for enterprise readiness, aligning development, production, delivery, and sustainment for government agencies and industrial suppliers. It is a high-growth startup environment focused on making an impact in global security.
Create and publish coding benchmarks that challenge state-of-the-art frontier agents.
Shape the frontier of coding agents and publish impactful studies of interesting findings.
Help top AI labs improve their models for coding through benchmarks, open-source tools, and research.
Handshake's mission is to organize expert human knowledge to advance the AI economy, working directly with frontier labs on data, evaluations, and post-training challenges. It is a rapidly growing startup with a small, high-ownership technical team from top AI companies.
Own agent definition, problem selection, and the human-in-the-loop contract.
Work hands-on with AI Lab engineers and the CEO to prototype, evaluate, and ship WFM agents.
Own build quality, evaluation, FRDs, commercialization, and design-partner delivery.
Legion Technologies provides an AI-driven workforce management platform that maximizes labor efficiency and employee engagement for hourly workers. It is a remote, mission-driven company with a collaborative, fast-paced culture.
Complete specialized legal tasks and structured workflows based on provided prompts.
Analyze complex legal subject matter to produce accurate, high-quality responses.
Manage an ongoing, flexible weekly commitment using software-based time tracking.
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Set grand challenges in your field by identifying open problems where Claude falls short of expert judgment.
Build comprehensive datasets, simulations, and rigorous evaluations to test models' ability to plan, interpret, and reason.
Apply Claude to open problems in your domain, using test-time compute and integrating scientific tools.
Anthropic builds reliable, interpretable, and steerable AI systems to make AI safe and beneficial for society. Our quickly growing team of researchers, engineers, policy experts, and business leaders collaborates on frontier AI research.