Source Job

Global

  • Evaluate AI-generated customer service responses and technical content for clarity, helpfulness, and accuracy.
  • Validate and troubleshoot JSON structure and formatting against project guidelines.
  • Provide clear written feedback explaining your reasoning for each evaluation.

JSON Programming AI Evaluation Written Communication Quality Assurance

15 jobs similar to AI Coding Evaluator

Jobs ranked by similarity.

$30–$60/hr
Global

  • Design realistic legal tasks based on professional legal research, contract analysis, litigation support, and regulatory review workflows.
  • Analyze contracts, statutes, regulations, and case law to develop evaluation criteria for AI agents.
  • Review AI-generated legal analyses for accuracy, completeness, jurisdictional relevance, and logical consistency.

Anyone AI creates high-quality training and evaluation data for frontier AI models. They provide contract opportunities for experts to contribute to AI development.

$30–$60/hr
Global

  • Design realistic healthcare and medical tasks that challenge advanced AI agents.
  • Analyze clinical records, research findings, and healthcare data to identify inconsistencies and errors.
  • Develop reference solutions and evaluation criteria for AI-generated medical analyses.

Anyone AI creates high-quality training and evaluation data for frontier AI models. The company offers flexible, remote contract work focused on expert-driven AI evaluation and improvement.

$30–$60/hr
Global

  • Design realistic financial analysis and accounting tasks for AI model evaluation.
  • Build and validate financial models, forecasts, budgets, and cash flow projections.
  • Create reference solutions and review AI-generated financial outputs for accuracy.

Anyone AI creates high-quality training and evaluation data for frontier AI models. They offer flexible, remote contract work for experts to help improve AI capabilities.

Global

  • Review and label AI-generated conversation transcripts for language quality and technical accuracy.
  • Evaluate JSON structures, formatting, and overall response quality using structured rubrics.
  • Participate in live, real-time audio scenarios and capture required session artifacts.

An enterprise client is seeking contractors to help improve AI-generated audio outputs through expert evaluation. The project offers flexible scheduling and the potential for ongoing work beyond the initial 2-3 month period.

Global

  • Record short, one-sided phone calls in French using your iPhone to help train voice AI.
  • Follow a simple 6-step call flow and pause where the agent would respond; use only fake personal details.
  • Earn $3.70 per approved session, with payouts from $14.80 up to $37 for completing 4–10 sessions.

CrowdGen by Appen runs AI training projects that improve voice and language models. You'll join a global community of independent contractors working on flexible, remote tasks.

Canada

  • Listen carefully to recorded conversations between a person and an AI voice agent.
  • Rate each agent turn on two 1–5 scales: Content (helpfulness/relevance) and Prosody (naturalness/expressiveness).
  • Write short, specific justifications for each score given.

Welo Data provides AI services, specializing in evaluating and improving AI voice agents through detailed audio rating. As a growing community of freelancers, they emphasize attention to detail and clear communication for project-based work.

US

  • Evaluate AI-generated content in Malayalam for linguistic accuracy and cultural relevance.
  • Translate prompts from English to Malayalam and interact with an AI assistant.
  • Provide structured evaluations and feedback following project quality guidelines.

RWS is a global leader in language services and technology, providing translation, localization, and AI training solutions. The company values innovation, quality, and cultural expertise, offering flexible freelance opportunities for language professionals.

$31–$31/hr
Canada

  • Audit 30% of production output to ensure rating quality and consistency during the pilot phase.
  • Identify and flag miscalibration or inconsistent scoring across raters.
  • Provide clear, actionable feedback and corrections to raters to maintain alignment.

Welo Data provides AI services, focusing on data annotation and quality assurance for machine learning models. They are a global freelance community with a collaborative, independent culture.

UK

  • Listen to recorded conversations between users and AI voice agents to evaluate response quality.
  • Rate each agent turn on two scales: content helpfulness and prosody naturalness.
  • Write short, specific justifications for each score given.

Welo Data is an AI services company that provides evaluation and data services for AI voice agents. They are a global organization with a freelance workforce, focusing on quality assessment of AI interactions.

US

  • Evaluate conversations between users and AI voice agents for content quality and prosody.
  • Rate each AI agent turn on a 1–5 scale and provide written justification.
  • Maintain consistent, well-reasoned ratings with strong attention to detail.

Welo Data provides AI services, specializing in data annotation and evaluation for machine learning models. As a global company, they offer freelance opportunities for detail-oriented contractors to support AI development projects.

New Zealand

  • Evaluate conversations between users and AI voice agents by listening to recorded interactions.
  • Rate each AI agent turn on two 1-5 scales: content quality and prosody naturalness.
  • Provide clear, specific written justifications for each rating given.

Welo Data provides AI services, specializing in data evaluation and human feedback for AI systems. They are an established company with a global community of freelancers and a focus on remote, collaborative work.

Global

  • Participate in a paid remote video call about your AI-assisted development workflow.
  • Share how you use tools like GitHub Copilot, Cursor, or Claude Code to write and debug code.
  • Discuss strengths, limitations, and prompt strategies of current code generation models.

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Global

  • Collect data according to detailed project guidelines and specifications.
  • Ensure collected data meets the project's required standards and apply feedback for corrections.
  • Maintain consistent quality and productivity throughout the project.

Our enterprise client is a leading provider of high-quality, diverse datasets for AI model development. They are seeking skilled contributors to support AI training initiatives focused on improving AI-powered language and speech models.

$18–$18/hr
US

  • Evaluate AI-generated content in Telugu for linguistic accuracy and naturalness.
  • Translate prompts from English to Telugu and interact with an AI assistant.
  • Provide structured feedback on localization quality and cultural appropriateness.

RWS is a language solutions company that helps improve AI applications through linguistic evaluation. This project is a short-term freelance collaboration with flexible remote work from the United States.

US

  • Evaluate AI-generated content in Marathi for linguistic accuracy and cultural relevance.
  • Translate prompts from English into Marathi and interact with an AI assistant.
  • Provide structured quality assessments following project guidelines.

RWS is a global leader in technology-enabled language services, helping organizations deliver multilingual content and train next-generation AI. This project-based freelance role with RWS TrainAI offers flexible remote work and collaboration with a diverse team of language experts.