Develop structured financial scenarios and training tasks for AI models, including investment memos, valuation exercises, and financial models.
Work remotely on a paid project with initial interviews and a trial period, translating real-world finance work into testable problems.
Submit generated problems for review and quality assurance, ensuring high standards for AI training data.
Terac is building the world's largest pool of vetted human experts for AI. They recruit, screen, and pay study participants across industries, languages, and skill sets, enabling AI researchers to access specialized knowledge.
Lead data sourcing and collection programs, writing specifications and setting acceptance criteria.
Manage media capture and document contribution at scale, curating and validating datasets.
Design synthetic data generation pipelines and validation checks to assess data quality.
An expert network that matches experienced data operations professionals with project work based on their backgrounds. The network offers flexible remote opportunities with projects ranging from one week to several months.
Review technical slide decks from your specific domain.
Rank presentations based on clarity, structure, and technical communication.
Provide clear feedback on what makes a specific presentation effective.
Terac is building the world's largest pool of vetted human experts for AI, enabling researchers and product teams to recruit, screen, and pay study participants. The company connects professionals across industries and skill sets for flexible remote work on AI training.
Complete a 30-minute product assessment to qualify for ongoing remote work.
Translate real product workflows into structured training problems for AI.
Detail your approach to specs, metrics, and launch decisions while committing 20+ hours weekly.
Terac is building the world's largest pool of vetted human experts for AI. Their platform helps researchers, AI labs, and product teams recruit and pay participants across industries globally.
Review and evaluate multiple business presentation slide decks
Compare presentations to determine which exhibits higher professional quality
Provide detailed reasoning for your comparative assessments verbally
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Lead benchmark design, validation, and grading operations for AI research projects.
Write rubrics, develop gold-standard answers, and analyze model failures.
Design rigorous model comparison studies and user studies on model interactions.
Surge AI connects senior evaluation experts to support AI research and model testing. The company focuses on rigorous benchmark design and grading for AI systems, with a network of specialized contractors working on diverse projects.
Translate real economic analysis into structured tasks for AI training
Evaluate model outputs for accuracy in forecasting, policy, and trade
Create detailed prompts based on economic impact studies
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Label and annotate objects, text, or visual data according to strict guidelines.
Review and verify the accuracy of datasets used to train AI models.
Consistently follow project rules and quality standards to ensure data integrity.
Mindy Support develops modern artificial intelligence and machine learning training solutions. They are a growing global team with a focus on data annotation and flexible remote work.
Develop realistic HR and People Operations tasks covering payroll, workforce planning, and employee lifecycle management.
Translate complex HR workflows into structured assignments with clear instructions, documentation, and measurable outcomes.
Design scenarios requiring professional judgment, analytical thinking, and objective evaluation criteria.
They develop and evaluate advanced AI systems using real-world professional scenarios. The organization values hands-on expertise, analytical thinking, and translating complex workflows into defined evaluation tasks.
Analyze complex datasets, evaluate AI-generated outputs, and assess machine learning models for accuracy and reliability.
Perform technical data annotation, Python code assessment, and SQL query evaluation for data science-related projects.
Collaborate on improving AI reasoning capabilities through detailed statistical analysis and model performance evaluation.
A partner company focuses on developing and improving advanced AI systems through specialized data annotation and model training projects. They offer a flexible, part-time remote opportunity for professionals passionate about data and artificial intelligence.
Write realistic Excel tasks derived from your own People Ops/HR work, including extending models, fixing broken ones, and building from a brief.
Complete each task yourself so a clear, correct answer exists.
Draft yes-or-no criteria that allow graders to mark any attempt consistently.
Aptura is an applied AI and data company that builds high-quality evaluation and training environments for AI systems. It works with frontier labs and independent contractors on a project basis, teaching AI to perform real professional work.
Design realistic, multi-step finance and accounting tasks based on professional workflows such as FP&A, financial reporting, auditing, and reconciliations.
Develop objective grading criteria and evaluation standards to assess AI system performance consistently.
Create scenarios requiring financial judgment, analytical reasoning, and error identification, supported by materials like Excel spreadsheets and financial statements.
The client organization focuses on the development and evaluation of advanced AI systems, particularly for complex professional tasks. It brings together experienced finance and accounting professionals to establish evaluation standards and improve AI-driven solutions.
Design and build offensive cybersecurity reinforcement learning environments.
Harden existing benchmarks to withstand advanced AI interactions.
Develop rigorous evaluation criteria for frontier AI models.
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Set the editorial standard for Antenna's insights and raise the bar on published analysis.
Build and lead a high-performing remote team of analysts, hiring and developing talent.
Run custom data delivery, define KPIs, and partner with clients and leadership to drive engagement.
Antenna is the leading provider of data and analytics for subscription media services in the U.S., offering standardized metrics and competitive benchmarks. As a small remote-first team, Antenna is powered by intellectually curious individuals and backed by top investors.
Evaluate and provide feedback on search engine results, text, audio, images, and videos to enhance AI data quality.
Conduct online research to assess relevance and significance of content, ensuring accuracy and quality standards.
Work flexible part-time hours (10-20 per week) remotely, contributing to the improvement of AI-powered search experiences.
RWS is a global leader in language services and technology, providing translation, localization, and AI training data solutions. The TrainAI division focuses on improving AI models through human feedback, fostering a flexible and inclusive culture for remote workers.
Review and approve final deliverables for analytical soundness, traceability, limitations, scope, and acceptance criteria.
Check that findings are supported, data gaps and uncertainty are stated, and AI-assisted results were validated by a person.
Document required corrections, confirm they were made, and record your approval.
TechSilo is a small technology and engineering services firm in Fredericksburg, Virginia, supporting federal defense customers and growing into higher education and public-sector analytics. The team is small and senior, with the CEO serving as Program Director, so your review goes directly to decision makers.
Write realistic Excel tasks drawn from marketing analytics work, including CAC, attribution, and campaign performance.
Work through each task and write yes-or-no criteria precise enough for grading.
Use AI tools and Excel experience to evaluate how well frontier AI models do analyst work.
Aptura is an applied AI and data company working with frontier labs to train AI systems on real professional work. It builds high-quality evaluation and training environments that teach AI agents to produce work for daily workflows, offering flexible remote contracts.
Build and maintain the marketing data layer, developing pipelines and dimensional models for report-ready analytics.
Extend BI data models with metadata and business context to power AI agents and natural language analytics interfaces.
Drive AI quality assurance, predictive analysis, and cross-functional collaboration to ensure reliable, governed data insights.
At Wellhub, we're revolutionizing workplace wellness by connecting employees worldwide to fitness, mindfulness, therapy, nutrition, and sleep partners in one subscription. Headquartered in NYC with a global team across Europe, North America, and South America, we value wellbeing, collaboration, and diverse perspectives.