Design realistic software engineering challenges to assess AI models' coding abilities.
Build reference solutions and automated verification tests to ensure correctness.
Work independently on a fully remote, contract basis with flexible scheduling.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective, AI-driven reviews. The company focuses on efficient hiring and shares top-fitting candidates directly with employers, with a culture emphasizing data privacy and fair evaluation.
Evaluate AI-generated code for correctness, efficiency, maintainability, and overall software quality.
Develop challenging programming problems, reference solutions, and comprehensive test cases.
Provide clear, detailed written technical feedback to support continuous AI model improvement.
Our client is a leading organization in the artificial intelligence industry, collaborating with top technology companies and AI research teams to advance next-generation AI systems. The company offers a remote, contract-based culture focused on evaluating AI-generated code and improving AI model performance alongside highly skilled technical professionals.
Evaluate software engineering tasks for technical accuracy, realism, and reproducibility.
Investigate codebases, tests, and integration issues to identify technical weaknesses.
Provide clear, actionable feedback that directly improves AI training and evaluation workflows.
Jobgether is an AI-powered job platform that connects candidates to roles through objective, skill-based matching. It focuses on remote and freelance opportunities, with a data-driven recruitment process and a global candidate pool.
Curate high-quality code examples and datasets for LLM training and evaluation.
Develop and assess AI-generated software across multiple programming languages and the full SDLC.
Collaborate with research teams to design verification mechanisms and improve coding benchmarks.
This partner company specializes in evaluating large language models and improving AI systems through rigorous engineering benchmarks. It offers a remote, collaborative culture where engineers and researchers advance AI evaluation workflows together.
Design and develop scalable Java applications using Java 11+ and Spring Boot.
Apply TDD and clean code practices to ensure quality, performance, and maintainability.
Collaborate asynchronously with a team that values knowledge sharing and architectural discussions.
Security & IT builds scalable and reliable digital financial products. The company fosters an engineering culture that prioritizes software quality, automated testing, sound architecture, and continuous improvement.
Design and conduct realistic role-play scenarios for AI evaluation in travel, finance, and technical support.
Evaluate AI-generated audio conversations for accuracy, naturalness, and task completion.
Assess basic programming literacy and generate high-quality audio evaluation datasets.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. This freelance AI trainer project focuses on evaluating conversational AI through realistic audio interactions, offering a flexible remote work environment for independent contractors.
Develop and maintain full-stack applications using Java, Spring Boot, Angular, and TypeScript.
Own product development end-to-end, from architecture to deployment, within an autonomous engineering team.
Use and critically review AI-generated code while applying modern application security practices.
The company focuses on transforming complex global work compliance into automated technology in an AI-first, security-driven environment. With a remote-first culture, it emphasizes autonomy, continuous learning, and high-impact product ownership, though specific employee numbers are not disclosed.
Build, maintain, and improve backend services using Java, Maven, Node.js.
Collaborate with client engineering teams to ensure reliable builds and quality.
Apply CI/CD and Generative AI tools to deliver practical enhancements.
They are an international software development company that builds reliable, high-quality solutions for global clients. The culture values technical excellence, collaboration, and continuous learning, with a people-first and inclusive environment.
Design and build rigorous Terminal-Bench tasks to test LLM capabilities in multilingual software engineering and terminal workflows.
Create realistic task environments with datasets and files in your native language to measure multilingual robustness without English translation crutches.
Support reference solutions, write deterministic verifier scripts, and calibrate task difficulty across varied model tiers.
LILT provides AI-powered multilingual translation and language services for enterprises, governments, and AI developers. It is a global community of linguists and software engineers focused on innovation and human-verified AI solutions.
Evaluate AI-generated coding interactions end to end for correctness and engineering judgment.
Assess whether outputs reflect strong engineering taste and provide clear, opinionated feedback.
Help define what great looks like for AI coding tools like Codex, Claude Code, and Cursor.
G2i Inc. is a technology staffing company that connects software engineers with remote contract opportunities. The company values engineering excellence and provides flexible, ongoing projects for senior-level developers.
Design and build automated evaluation pipelines for AI agents.
Develop testing frameworks for reasoning, multi-turn conversations, and adversarial scenarios.
Own the evaluation architecture and integrate observability tools in a fully remote team.
A company building production-grade AI agents and systems. They operate in a fully remote, globally distributed environment with a culture focused on innovation, autonomy, and continuous improvement.
Set technical direction and own architecture for major services and integrations within Internal Platforms.
Design, build, and maintain Java-based backend services that are scalable, resilient, and well-tested.
Mentor engineers, partner with cross-functional teams, and drive predictable delivery for complex initiatives.
Fanatics builds a leading global digital sports platform for commerce, collectibles, and betting & gaming. With over 22,000 employees, it is committed to enhancing the fan experience and delighting sports fans globally.