Evaluate AI-generated code for correctness, efficiency, maintainability, and overall software quality.
Develop challenging programming problems, reference solutions, and comprehensive test cases.
Provide clear, detailed written technical feedback to support continuous AI model improvement.
Our client is a leading organization in the artificial intelligence industry, collaborating with top technology companies and AI research teams to advance next-generation AI systems. The company offers a remote, contract-based culture focused on evaluating AI-generated code and improving AI model performance alongside highly skilled technical professionals.
Design realistic mechanical engineering tasks based on product development, manufacturing, and industrial workflows.
Create and validate technical drawings, 3D CAD models, assemblies, and engineering calculations.
Review AI-generated engineering outputs for accuracy, feasibility, and compliance with requirements.
Anyone AI creates high-quality training and evaluation data for frontier AI models. It operates as a remote-first contractor-based team, emphasizing technical rigor and expert collaboration.
Own product features end-to-end, from problem statement to production.
Write specs with AI agents and critically review their code in complex systems.
Deliver reliable features handling financial transactions and evolve AI-first development.
Social Discovery Group creates social entertainment platforms that connect people online across cultures, addressing loneliness and disconnection. The company's international remote team works from everywhere, and it earned 'Great Place to Work' recognition in 2024-2025.
Design realistic software engineering challenges to assess AI models' coding abilities.
Build reference solutions and automated verification tests to ensure correctness.
Work independently on a fully remote, contract basis with flexible scheduling.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective, AI-driven reviews. The company focuses on efficient hiring and shares top-fitting candidates directly with employers, with a culture emphasizing data privacy and fair evaluation.
Own product features end-to-end, from problem identification to production.
Work with AI agents to create specs and delegate development tasks.
Critically review AI-generated code to ensure reliability and quality.
Our partner company is seeking a Product Engineer to own features end-to-end in an AI-native environment. They are a remote, international team with an AI-first culture and a focus on using AI agents as primary development partners.
Evaluate software engineering tasks for technical accuracy, realism, and reproducibility.
Investigate codebases, tests, and integration issues to identify technical weaknesses.
Provide clear, actionable feedback that directly improves AI training and evaluation workflows.
Jobgether is an AI-powered job platform that connects candidates to roles through objective, skill-based matching. It focuses on remote and freelance opportunities, with a data-driven recruitment process and a global candidate pool.
Design realistic tasks for AI evaluation covering circuit analysis, electronics, and PCB design.
Create and validate technical reference solutions to assess AI-generated engineering outputs.
Collaborate with experts to develop objective criteria for accuracy and completeness.
Jobgether is a job platform using AI-powered matching to connect candidates with remote and contract roles. It focuses on fast, objective, and fair recruitment processes for partner companies.
Design realistic electrical engineering tasks based on electronics development, circuit analysis, and electrical systems design.
Create and validate electrical schematics, PCB layouts, and technical specifications for AI evaluation.
Review AI-generated designs for technical accuracy and establish reference solutions.
We create high-quality training and evaluation data for frontier AI models. We are a flexible, remote-first organization assembling a team of expert contractors to advance AI systems.
Design and build automated evaluation pipelines for AI agents.
Develop testing frameworks for reasoning, multi-turn conversations, and adversarial scenarios.
Own the evaluation architecture and integrate observability tools in a fully remote team.
A company building production-grade AI agents and systems. They operate in a fully remote, globally distributed environment with a culture focused on innovation, autonomy, and continuous improvement.
Curate high-quality code examples and datasets for LLM training and evaluation.
Develop and assess AI-generated software across multiple programming languages and the full SDLC.
Collaborate with research teams to design verification mechanisms and improve coding benchmarks.
This partner company specializes in evaluating large language models and improving AI systems through rigorous engineering benchmarks. It offers a remote, collaborative culture where engineers and researchers advance AI evaluation workflows together.
Embed with business and clinical teams to learn workflows and identify where AI can reduce manual work.
Ship production-quality AI tools that turn six-to-eight-hour tasks into under thirty minutes, using telemetry and privacy-by-design.
Drive adoption until teams run the tools independently, then turn learnings into reusable building blocks.
Rula is a mental health care company making mental healthcare work for everyone through evidence-based, compassionate care. It is remote-first, inclusive, and hires across most U.S. states.
Building multi-agent systems and implementing agent-based workflows and AI automation solutions.
Developing and optimizing prompt engineering strategies, including evaluation and iteration.
Integrating LLMs and AI models into cloud-based applications and APIs while researching new AI tools.
Software Mind develops impactful software solutions for global companies, partnering with tech giants and unicorns on transformative projects. The company builds cross-functional engineering teams and embraces a culture of openness, respect, grit, and cooperation.
Evaluate GPU kernel tasks for technical accuracy, realism, and reproducibility.
Identify memory allocation bugs, execution bottlenecks, and errors in parallel computing logic.
Provide clear, actionable feedback to improve AI training and evaluation workflows.
A partner company operating a specialized AI training project to improve the technical accuracy of AI systems. The company seeks experienced technical professionals for freelance, remote evaluation work, emphasizing precision and evidence-based assessment.
Build simulation and real-world environments for training and evaluating embodied agents.
Train long-horizon robots with RL, imitation learning, and world models under hardware constraints.
Run post-training experiments to find what works and share reusable open-source systems.
Prime Intellect builds the open superintelligence stack, making frontier AI infrastructure available to ambitious AI teams. With $150M in funding from top investors, they are a well-funded startup focused on open-source AI and decentralized training.
Use your mechanical engineering experience to help us rethink how engineering teams work.
Explore roles like Solutions Engineer, Customer Solutions Engineer, or Mechanical Engineer, depending on your interests.
Share your background and what excites you about CoLab—we'll reach out as relevant opportunities arise.
CoLab builds AI software that helps mechanical engineering teams bring complex products to market faster. Proudly based in St. John’s, Newfoundland, the company has grown to a team of 250+ and values collaboration and continuous learning.
Evaluate AI-generated coding interactions end to end for correctness and engineering judgment.
Assess whether outputs reflect strong engineering taste and provide clear, opinionated feedback.
Help define what great looks like for AI coding tools like Codex, Claude Code, and Cursor.
G2i Inc. is a technology staffing company that connects software engineers with remote contract opportunities. The company values engineering excellence and provides flexible, ongoing projects for senior-level developers.
Work directly with operations, finance, clinical, and business teams to identify bottlenecks and design practical AI-driven solutions.
Build automations, dashboards, and lightweight internal applications using Python, SQL, APIs, and low-code tools.
Own projects end-to-end from problem discovery to deployment, delivering measurable business impact.
Urrly is a healthcare technology company that uses AI to improve operational efficiency and accuracy. It emphasizes fairness in hiring, using AI to review applications based solely on job-related factors.
Study how engineers and customers use Archie in the field, identify where it succeeds or fails, and turn observations into actionable evaluations.
Recreate real-world engineering tasks and failure modes in repeatable environments for development teams.
Build and refine evaluation methodologies, including automated judges and human evaluation processes, to align with expert judgment.
P-1 AI is building Archie, an AI engineer agent for the physical world that works alongside human engineering teams. The company recently raised a $50 million Series A led by NEA and is driven by the mission of building superintelligence for engineering.
Design and execute test cases to validate AI-generated outputs.
Review and annotate datasets to improve machine learning model quality.
Analyze model predictions and report findings to enhance performance.
Jobgether is an AI-powered job matching platform that connects candidates with roles from partner companies. It uses algorithmic shortlisting to ensure applications are reviewed quickly and fairly, and it emphasizes data privacy and transparent hiring processes.
Build evaluations to measure and improve AI reasoning in complex, high-stakes decisions.
Collaborate with engineers, product, and domain experts to turn observed failures into testable improvements.
Own the quality of shipped systems, from code reviews to monitoring and integration.
Elicit builds AI systems that help research and business teams make evidence-based decisions on high-stakes questions. They are a remote-friendly, collaborative team that values rigorous thinking, experimentation, and in-person retreats.