Source Job

Global

  • Work on your personal software project using an AI coding assistant to build features, fix bugs, refactor code, and improve documentation.
  • Review and compare two versions of AI-generated coding responses, selecting the more useful and accurate one.
  • Provide clear, honest feedback explaining your choice, without using AI assistance for evaluations.

Software Development Git Code Review

13 jobs similar to Software Developer – AI Coding Assistant Evaluation Contract

Jobs ranked by similarity.

Global

  • Evaluate AI-generated code for correctness, efficiency, maintainability, and overall software quality.
  • Develop challenging programming problems, reference solutions, and comprehensive test cases.
  • Provide clear, detailed written technical feedback to support continuous AI model improvement.

Our client is a leading organization in the artificial intelligence industry, collaborating with top technology companies and AI research teams to advance next-generation AI systems. The company offers a remote, contract-based culture focused on evaluating AI-generated code and improving AI model performance alongside highly skilled technical professionals.

India

  • Evaluate AI-generated coding interactions from beginning to end, assessing quality and effectiveness.
  • Provide detailed, opinionated written feedback on AI outputs and reasoning.
  • Help define and refine quality benchmarks for AI coding agents.

The company focuses on improving AI coding agents through expert evaluation. It operates with a small, remote team and values technical excellence and critical thinking.

US

  • Design realistic software engineering challenges to assess AI models' coding abilities.
  • Build reference solutions and automated verification tests to ensure correctness.
  • Work independently on a fully remote, contract basis with flexible scheduling.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective, AI-driven reviews. The company focuses on efficient hiring and shares top-fitting candidates directly with employers, with a culture emphasizing data privacy and fair evaluation.

Brazil

  • Evaluate AI-generated Java solutions for correctness, efficiency, and maintainability.
  • Analyze object-oriented design, concurrency, JVM behavior, data structures, algorithms, and architecture.
  • Document recurring model failure patterns and communicate findings in a structured, actionable way.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. It posts roles on behalf of partner employers and emphasizes objective, fair application reviews.

US

  • Evaluate AI-generated code and technical reasoning for front-end development tasks.
  • Provide structured feedback to improve model accuracy, accessibility, and design quality.
  • Work fully remotely on a freelance basis with flexible, project-based engagement.

Jobgether is an AI-powered recruitment platform that matches candidates with hiring companies through an objective review process. It operates with a remote-first culture and leverages AI tools to support recruitment while keeping final decisions human-led.

$35–$35/hr
Global

  • Paste in code you wrote yourself.
  • Explain what it does and why you built it that way.
  • Get paid $7 per accepted submission, no interview or minimum hours.

Kled is building a consumer app that pays people for their real photos, videos, and documents, then licenses that data to AI labs. The company has scaled to 600,000+ contributors and raised $15M+ from top investors.

Canada

  • Design, develop, test, and maintain secure, high-quality software components for enterprise-grade products.
  • Build client-side applications using JavaScript, TypeScript, React, and Redux, and integrate AI coding assistants like Claude Code and GitHub Copilot.
  • Contribute to cross-platform development, code reviews, and continuous improvement of software architecture and engineering workflows.

Jobgether uses an AI-powered matching process to review applications and share top-fitting candidates with hiring companies. We are a technology-driven recruitment platform focused on fair and efficient hiring.

Global

  • Design and build rigorous Terminal-Bench tasks to test LLM capabilities in multilingual software engineering and terminal workflows.
  • Create realistic task environments with datasets and files in your native language to measure multilingual robustness without English translation crutches.
  • Support reference solutions, write deterministic verifier scripts, and calibrate task difficulty across varied model tiers.

LILT provides AI-powered multilingual translation and language services for enterprises, governments, and AI developers. It is a global community of linguists and software engineers focused on innovation and human-verified AI solutions.

$125,000–$150,000/yr
US

  • Build AI applications across client engagements, products, and reusable tools.
  • Partner with clients and consultants to translate business problems into software.
  • Use agentic coding tools like Claude Code and Codex to build and maintain solutions.

P3 Adaptive is an AI and data consultancy built on Microsoft technologies, helping organizations modernize their relationship with data. The company has small, senior, hands-on teams and a culture that values reliability, adaptability, and direct communication.

Australia 6w PTO

  • Own product features end-to-end, from problem identification to production.
  • Work with AI agents to create specs and delegate development tasks.
  • Critically review AI-generated code to ensure reliability and quality.

Our partner company is seeking a Product Engineer to own features end-to-end in an AI-native environment. They are a remote, international team with an AI-first culture and a focus on using AI agents as primary development partners.

Latin America

  • Build and maintain open source AI integrations and frameworks for Backblaze B2 Cloud Storage.
  • Use AI coding agents like Claude Code to accelerate development, testing, and maintenance.
  • Contribute to open source projects and maintain clean GitHub repositories for community adoption.

Backblaze provides reliable, high-availability cloud storage trusted by consumers, SMBs, enterprises, and developers in over 150 countries. It is a remote-first company that values diversity, equity, inclusion, and work-life balance.

US

  • Develop and enhance software applications using modern programming languages and AI-assisted development tools such as Claude Code, Cursor, GitHub Copilot, and OpenAI Codex.
  • Collaborate with software engineers and technical architects to identify AI-driven improvements, build prototypes, and automate development workflows.
  • Support technical research and federal proposal development while ensuring AI-assisted solutions meet compliance, security, and quality standards.

Mind Computing is an IT company focused on AI-driven software development, automation, and innovation for enterprise and federal projects. The company values curiosity, collaboration, and continuous learning, and is an equal opportunity employer.