Design difficult chemistry problems that reflect real scientific workflows
Create deterministic tasks with one correct answer and full verified solutions
Develop reasoning-intensive and computationally grounded problems
They create high-quality STEM training data for frontier AI models that is directly used in training and evaluation workflows at leading AI labs. The company is a small team of contractors, and they value technical rigor and clear documentation.
Design difficult chemistry problems reflecting real scientific workflows.
Create deterministic tasks with one correct answer and full verified solutions.
Develop reasoning-intensive and computationally grounded problems using Python.
Anyone AI creates high-quality STEM training data for frontier AI models used by leading AI labs. The company is a remote-first, small team offering part-time contract work.
Create original graduate-to-PhD-level academic problems in your field
Write rigorous, step-by-step solutions with exact and verifiable answers
Review AI-generated responses to identify specific reasoning errors
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Contribute to technical approach for evaluating AI agents' reasoning through biological function, recovering and interpreting experimental evidence.
Build ground-truth benchmark datasets from real discovery programs to test agents' quantitative reasoning capabilities.
Use expertise in functional biology assays and computational modeling to define metrics for agent capability in biological sequences and structures.
LatchBio builds intelligent, high-performance agents for biological data analysis, empowering over 5,000 scientists across 150+ R&D labs. They work at the frontier of artificial intelligence in biology.
Review domain archives to understand subject matter and extract key facts.
Create accurate question-and-answer pairs covering various complexity levels.
Ensure answers are traceable, unambiguous, and consistent with approved source content.
Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise. With over 36 years of experience, the company delivers high-quality data and outcomes for Generative AI builders.
Lead development of Dyno’s external-facing AI platforms (e.g., design.dynotx.com)
Develop field-relevant benchmarks for agentic tasks in biological design
Build and improve AI-driven workflows that integrate models, data systems, and experimental feedback
Dyno Therapeutics is a biotech company that develops AI-driven genetic technologies to transform patient lives. They are a high-energy, high-impact team of world-class scientists and engineers working at the intersection of AI and genetic medicine.
Compare and rank AI-generated responses for accuracy, logic, and safety.
Review CS research papers alongside AI summaries to ensure scientific integrity.
Fact-check technical data and code for logical flaws and inaccuracies.
Prolific is building the largest pool of quality human data in the world, serving over 35,000 AI developers and researchers. They connect researchers with paid participants to gather high-quality, ethically sourced behavioral data for AI development.
Review AI-generated responses to clinical scenarios for accuracy and safety.
Compare and justify the best responses among multiple model answers.
Write improved exemplars and structured feedback to enhance AI model learning.
Prolific is building the largest pool of quality human data in the world, used by over 35,000 AI developers and researchers. It is a platform that connects researchers with a global participant pool for ethically sourced human data.
Create realistic, domain-specific tasks in the target language reflecting local natural sciences practices.
Adapt and apply clear scoring rubrics to evaluate AI-generated and human responses.
Review and score submissions for accuracy, regulatory alignment, and professional quality.
LILT provides multilingual AI and human-verified services to Enterprises, Governments, and AI Developers. They have a global community of linguists and subject matter experts focused on innovation and excellence.