Evaluate AI-generated data science deliverables, including exploratory analyses, statistical models, and machine learning pipelines, for technical quality and rigor.
Design precise grading criteria and provide detailed, evidence-based assessments to distinguish rigorous analysis from flawed work.
Apply your expertise in Python, SQL, and experimentation to improve the reliability and performance of AI systems.
Evaluate LLM responses for accuracy, clarity, and completeness.
Fact-check technical claims using authoritative references.
Validate code and outputs, and annotate model performance.
Prolific builds the largest pool of high-quality human data for AI development, serving over 35,000 AI developers, researchers, and organizations. They connect researchers with a global community to collect ethically sourced behavioral data.
Design and apply evaluation criteria for consulting deliverables such as market analyses and financial models.
Assess AI-generated and human work, providing evidence-based scores and justifications.
Work independently in a remote, asynchronous environment to improve AI model reasoning.
They are an AI-focused organization improving the quality of AI outputs through expert evaluation. The work is fully remote and asynchronous, with an emphasis on independent problem-solving and collaboration with senior reviewers.
Own analytics across the entire participant lifecycle, from acquisition to retention.
Build metrics, dashboards, and experimentation frameworks using SQL and Python.
Partner with Product, Operations, Growth, and Data Science to drive decisions.
We build the human data infrastructure for AI, connecting researchers with a global participant pool. We operate with a mission-driven culture focused on innovation and ethical data collection.
Collaborate with cross-functional teams to enhance the Lyra platform and serve provider and client needs.
Become an expert in diverse data sources, building pipelines and applying clinical logic to raw data.
Extract actionable insights, develop predictive and generative models, and support product iterations with rigorous evaluation frameworks.
Lyra Health is a leading provider of evidence-based mental health care, serving over 20 million people globally. The company has delivered more than 15 million sessions of mental health care and published over 35 peer-reviewed studies, with a culture focused on innovation and clinical effectiveness.
Evaluate AI-generated documents, spreadsheets, and presentation decks against quality rubrics.
Identify factual, formatting, visual, and structural issues in professional deliverables.
Provide clear, structured feedback to enhance AI output quality and consistency.
This partner company specializes in AI training and evaluation, focusing on improving the quality of AI-generated professional content. Operating as a remote and asynchronous team, they value precision, collaboration, and independent work.
Assess complex consulting deliverables including market analyses, strategic recommendations, and financial models.
Create precise evaluation criteria and provide evidence-based assessments for AI-generated consulting work.
Work remotely and asynchronously while collaborating with senior reviewers.
Our partner is a company seeking management consultants to evaluate and improve AI systems. They offer a remote, asynchronous work environment with competitive compensation.
Build models and data products that go from prototype to production, including generative models and subscriber-behavior predictions.
Dig into large, messy datasets to uncover trends and patterns, and contribute to the core Python data science library.
Build LLM-powered pipelines and agents, with comprehensive evals to validate model responses.
DevSavant is an operating partner for startups and growth-stage companies, helping them turn ambition into execution. With over 8 years in venture-backed ecosystems, they are trusted to accelerate delivery and scale teams efficiently.
Own the first recommendation features, surfacing relevant connections and opportunities via collaborative filtering and ML.
Handle sparse data and cold-start, keeping recommendations subtle and trustworthy for finance users.
Own evaluation with offline metrics and online experiments, partnering with backend engineering on serving.
Termgrid builds the operating system for private capital markets, helping deal professionals manage financing workflows. Founded in 2019, the company is trusted by 4 of the top 5 global private equity firms, with 1,600+ institutions and 30,000+ professionals using the platform.
Evaluate and rank model outputs, stress-test models for failure modes, and create high-quality datasets with detailed rubrics.
Annotate and correct multimodal data, maintain consistency through calibration exercises, and adapt to evolving task types.
Report on model performance trends and provide clear feedback to cross-functional partners on model successes and failures.
Cohere is a security-first enterprise AI company that builds cutting-edge foundation models and end-to-end products for real-world business problems. It is a global technology company with offices in Toronto, San Francisco, London, New York, Montreal, Seoul, Germany, and Paris, staffed by a team of passionate researchers, engineers, and designers.
Design, build, and maintain scalable data pipelines for ingestion and transformation.
Work with Python, SQL, Apache Airflow, and Google Cloud Platform.
Collaborate with cross-functional teams to deliver reliable and high-quality data solutions.
Our partner is a technology company focused on AI and data solutions. The team values collaboration, innovation, and continuous learning, and offers a remote work environment.
Design and implement advanced data models, algorithms, and analytical solutions to address complex business challenges.
Analyze large and diverse datasets to identify trends, correlations, patterns, and opportunities for improvement.
Develop, test, and deploy machine learning models and statistical techniques to enhance predictive capabilities.
Our partner is a global, innovation-focused company in the healthcare and technology sector. They offer a remote working environment and seek to improve analytical capabilities and operational excellence.