Evaluate AI-generated coding interactions from beginning to end, assessing quality and effectiveness.
Provide detailed, opinionated written feedback on AI outputs and reasoning.
Help define and refine quality benchmarks for AI coding agents.
The company focuses on improving AI coding agents through expert evaluation. It operates with a small, remote team and values technical excellence and critical thinking.
Curate high-quality code examples and datasets for LLM training and evaluation.
Develop and assess AI-generated software across multiple programming languages and the full SDLC.
Collaborate with research teams to design verification mechanisms and improve coding benchmarks.
This partner company specializes in evaluating large language models and improving AI systems through rigorous engineering benchmarks. It offers a remote, collaborative culture where engineers and researchers advance AI evaluation workflows together.
Evaluate AI-generated code for correctness, efficiency, maintainability, and overall software quality.
Develop challenging programming problems, reference solutions, and comprehensive test cases.
Provide clear, detailed written technical feedback to support continuous AI model improvement.
Our client is a leading organization in the artificial intelligence industry, collaborating with top technology companies and AI research teams to advance next-generation AI systems. The company offers a remote, contract-based culture focused on evaluating AI-generated code and improving AI model performance alongside highly skilled technical professionals.
Design and build automated evaluation pipelines for AI agents.
Develop testing frameworks for reasoning, multi-turn conversations, and adversarial scenarios.
Own the evaluation architecture and integrate observability tools in a fully remote team.
A company building production-grade AI agents and systems. They operate in a fully remote, globally distributed environment with a culture focused on innovation, autonomy, and continuous improvement.
Design realistic software engineering challenges to assess AI models' coding abilities.
Build reference solutions and automated verification tests to ensure correctness.
Work independently on a fully remote, contract basis with flexible scheduling.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective, AI-driven reviews. The company focuses on efficient hiring and shares top-fitting candidates directly with employers, with a culture emphasizing data privacy and fair evaluation.
Evaluate AI-generated JavaScript code for functional correctness and best practices.
Validate step-by-step explanations for complex algorithmic solutions.
Execute model-generated scripts to verify performance and output.
Prolific builds the largest pool of quality human data for AI development. Over 35,000 organizations use its platform to gather ethically sourced data from paid participants.
Develop and enhance software applications using modern programming languages and AI-assisted development tools such as Claude Code, Cursor, GitHub Copilot, and OpenAI Codex.
Collaborate with software engineers and technical architects to identify AI-driven improvements, build prototypes, and automate development workflows.
Support technical research and federal proposal development while ensuring AI-assisted solutions meet compliance, security, and quality standards.
Mind Computing is an IT company focused on AI-driven software development, automation, and innovation for enterprise and federal projects. The company values curiosity, collaboration, and continuous learning, and is an equal opportunity employer.
Develop full-stack features across React, Node.js, Python, and databases, owning assigned features from planning through deployment.
Direct AI coding agents for implementation, review agent-generated code for correctness and security, and use AI for research and prototyping.
Collaborate with engineers, product owners, and end users to deliver solutions, proactively identify improvements, and maintain CI/CD pipelines on AWS.
Expression is a government contractor providing data fusion, analytics, AI/ML, software engineering, IT, and spectrum management solutions to the U.S. Department of Defense and national security community. Founded in 1997 and headquartered in Washington DC, the company was ranked #1 on the Washington Technology 2018 Fast 50 and fosters a culture of agile delivery, continuous growth, and collaboration.
Build tools for understanding traces, evaluating agent behavior, and turning results into improvements.
Run experiments on Mastra's primitives to find where they fall short and improve configuration and behavior.
Help turn findings into capabilities developers can use in their own applications.
Mastra is the open-source TypeScript framework for building AI agents. We're a small, fully remote team backed by Y Combinator and Spark Capital with $35M raised.
Build AI applications across client engagements, products, and reusable tools.
Partner with clients and consultants to translate business problems into software.
Use agentic coding tools like Claude Code and Codex to build and maintain solutions.
P3 Adaptive is an AI and data consultancy built on Microsoft technologies, helping organizations modernize their relationship with data. The company has small, senior, hands-on teams and a culture that values reliability, adaptability, and direct communication.
Own product features end-to-end, from problem identification to production.
Work with AI agents to create specs and delegate development tasks.
Critically review AI-generated code to ensure reliability and quality.
Our partner company is seeking a Product Engineer to own features end-to-end in an AI-native environment. They are a remote, international team with an AI-first culture and a focus on using AI agents as primary development partners.
Own the agentic development environment, ensuring AI agents can operate autonomously in cloud-based environments and execute full test suites.
Build MCP server integrations to connect agents to internal systems like CircleCI, Slack, Datadog, and GitHub.
Drive enablement by owning repo-wide agent documentation and developing tooling for engineers and non-engineers.
Hightouch is a data activation platform that helps companies sync customer data to their business tools. It is a remote-first startup with a fast-paced, high-ownership culture.
Design and build rigorous Terminal-Bench tasks to test LLM capabilities in multilingual software engineering and terminal workflows.
Create realistic task environments with datasets and files in your native language to measure multilingual robustness without English translation crutches.
Support reference solutions, write deterministic verifier scripts, and calibrate task difficulty across varied model tiers.
LILT provides AI-powered multilingual translation and language services for enterprises, governments, and AI developers. It is a global community of linguists and software engineers focused on innovation and human-verified AI solutions.
Build evaluations to measure and improve AI reasoning in complex, high-stakes decisions.
Collaborate with engineers, product, and domain experts to turn observed failures into testable improvements.
Own the quality of shipped systems, from code reviews to monitoring and integration.
Elicit builds AI systems that help research and business teams make evidence-based decisions on high-stakes questions. They are a remote-friendly, collaborative team that values rigorous thinking, experimentation, and in-person retreats.
Own product features end-to-end, from problem statement to production.
Write specs with AI agents and critically review their code in complex systems.
Deliver reliable features handling financial transactions and evolve AI-first development.
Social Discovery Group creates social entertainment platforms that connect people online across cultures, addressing loneliness and disconnection. The company's international remote team works from everywhere, and it earned 'Great Place to Work' recognition in 2024-2025.
Design and build the infrastructure for AI agents to handle software development tasks from tickets to pull requests.
Orchestrate and integrate autonomous coding agents, development environments, and workflow tools like Slack and Jira.
Establish security guardrails, measure agent performance, and improve engineering speed and reliability.
The company builds an AI-powered engineering platform for fantasy sports, enabling autonomous agents to manage software delivery and improve developer productivity. It is a fast-growing, remote-first organization that values experimentation, collaboration, and AI automation.
Coach your pods of fellows by providing first eyes on pull requests and structured feedback on their real work.
Facilitate weekly 1:1s and lead milestone reviews to track fellow progress.
Deliver just-in-time curriculum and co-lead practical assessments.
CodePath is the largest educator of college computer science students, having trained over 40,000 students from 1,000+ universities. We are now expanding into new markets and scaling our team to move at the speed AI is transforming the workforce.
Build and maintain LLM-powered 'company brain' knowledge systems and agentic memory solutions.
Design, deploy, and operate production agentic applications with Claude Code, AWS, and robust harnesses.
Enable transformation through training, workshops, and stakeholder partnership across a 500-person organization.
TribalScale is a digital innovation firm that partners with clients to build transformative digital products, modernize platforms, and apply AI to business challenges. Its culture values curiosity, ownership, practical innovation, and collaboration across multidisciplinary teams.
Build and maintain open source AI integrations and frameworks for Backblaze B2 Cloud Storage.
Use AI coding agents like Claude Code to accelerate development, testing, and maintenance.
Contribute to open source projects and maintain clean GitHub repositories for community adoption.
Backblaze provides reliable, high-availability cloud storage trusted by consumers, SMBs, enterprises, and developers in over 150 countries. It is a remote-first company that values diversity, equity, inclusion, and work-life balance.