Source Job

Global

  • Design and build rigorous Terminal-Bench tasks to test LLM capabilities in multilingual software engineering and terminal workflows.
  • Create realistic task environments with datasets and files in your native language to measure multilingual robustness without English translation crutches.
  • Support reference solutions, write deterministic verifier scripts, and calibrate task difficulty across varied model tiers.

Python Shell Scripting Dutch

20 jobs similar to AI Benchmark Engineer | Native Language Specialist - Dutch

Jobs ranked by similarity.

Europe

  • Use software engineering expertise and Dutch fluency to evaluate and improve advanced AI systems.
  • Assess model responses for logical accuracy, coding quality, and adherence to best practices across multiple technical domains.
  • Document model failure modes and provide structured feedback to improve AI reasoning and coding performance.

$18–$18/hr
US

  • Evaluate AI-generated content in Telugu for linguistic accuracy and naturalness.
  • Translate prompts from English to Telugu and interact with an AI assistant.
  • Provide structured feedback on localization quality and cultural appropriateness.

RWS is a language solutions company that helps improve AI applications through linguistic evaluation. This project is a short-term freelance collaboration with flexible remote work from the United States.

US

  • Evaluate AI-generated content in Marathi for linguistic accuracy and cultural relevance.
  • Translate prompts from English into Marathi and interact with an AI assistant.
  • Provide structured quality assessments following project guidelines.

RWS is a global leader in technology-enabled language services, helping organizations deliver multilingual content and train next-generation AI. This project-based freelance role with RWS TrainAI offers flexible remote work and collaboration with a diverse team of language experts.

US 0w PTO

  • Evaluate and annotate AI-generated Welsh content for accuracy and fluency.
  • Identify linguistic, contextual, and cultural issues and provide actionable feedback.
  • Collaborate remotely with language specialists to improve AI language models.

The company is a technology organization developing next-generation AI systems with a focus on linguistic accuracy and cultural nuance. They operate as a remote freelance team, valuing language expertise and attention to detail.

US

  • Evaluate AI-generated content in Malayalam for linguistic accuracy and cultural relevance.
  • Translate prompts from English to Malayalam and interact with an AI assistant.
  • Provide structured evaluations and feedback following project quality guidelines.

RWS is a global leader in language services and technology, providing translation, localization, and AI training solutions. The company values innovation, quality, and cultural expertise, offering flexible freelance opportunities for language professionals.

India

  • Annotate text, image, audio, and video data to train large language models and AI systems.
  • Evaluate search results, ads, and chatbot outputs for factual accuracy, linguistic quality, and safety.
  • Provide detailed feedback and documentation to refine AI model reasoning and evaluation frameworks.

Our partner is a company focused on AI training and data annotation, working with a global network of linguists and tech enthusiasts. It values flexibility, transparency, and cultural accuracy in AI development.

US

  • Evaluate AI-generated responses in Tamil for linguistic accuracy and cultural relevance.
  • Translate prompts from English into Tamil and interact with an AI assistant.
  • Provide structured feedback following project guidelines and quality standards.

RWS is a global language services company providing translation, localization, and linguistic AI training solutions. Its TrainAI division hires freelance language experts to evaluate and improve AI systems through flexible, short-term projects.

Global

  • Translate content between English and Uzbek, preserving cultural nuance and clarity.
  • Edit and refine language content for accuracy, tone, and contextual relevance across digital platforms.
  • Collaborate with cross-functional teams to localize content for Uzbek-speaking markets.

LILT is a company that provides AI and human-verified translation services to enterprises, governments, and AI developers. They are a global community of linguists and professionals, with a focus on innovation and excellence.

Canada

  • Design and conduct realistic role-play scenarios for AI evaluation in travel, finance, and technical support.
  • Evaluate AI-generated audio conversations for accuracy, naturalness, and task completion.
  • Assess basic programming literacy and generate high-quality audio evaluation datasets.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. This freelance AI trainer project focuses on evaluating conversational AI through realistic audio interactions, offering a flexible remote work environment for independent contractors.

Ireland

  • Annotate and label text, images, audio, or other content to support AI model training.
  • Evaluate AI-generated outputs such as search results and chatbot responses for quality and relevance.
  • Create and refine prompts while reviewing Greek linguistic and cultural accuracy.

This opportunity is a talent network for Greek-speaking contributors supporting AI model training through annotation, evaluation, and prompt creation. It is a global, remote community of independent contributors with flexible project-based work.

Global

  • Record high-quality French speech samples for AI training datasets.
  • Evaluate AI-generated French audio for pronunciation, tone, and naturalness.
  • Provide detailed feedback and collaborate with technical teams to refine voice models.

The hiring partner is an innovative technology company focused on training cutting-edge conversational and expressive AI voice systems. They operate with a remote-first, autonomous freelance culture, collaborating with global talent to shape next-generation speech technology.

Poland

  • Annotate and label text, images, or audio to train and improve AI models.
  • Evaluate search results, chatbot responses, and AI-generated content for accuracy and relevance.
  • Create and refine prompts and review AI outputs for linguistic and cultural appropriateness.

AI Trainers Network connects language professionals with projects that improve AI accuracy, relevance, and inclusivity. It is a global, flexible remote network offering project-based opportunities and transparent compensation.

Europe

  • Annotate and label text, images, audio, or other content for AI training projects.
  • Evaluate AI-generated content for quality, relevance, accuracy, and overall usefulness.
  • Create, review, and test prompts to improve large language model performance.

AI Trainers Network is a global AI contributor network that shapes smarter and more human-centered AI through language and cultural expertise. It connects a diverse international community of independent contributors working on flexible, remote AI training projects.

Global

  • Collect data according to detailed project guidelines and specifications.
  • Ensure collected data meets the project's required standards and apply feedback for corrections.
  • Maintain consistent quality and productivity throughout the project.

Our enterprise client is a leading provider of high-quality, diverse datasets for AI model development. They are seeking skilled contributors to support AI training initiatives focused on improving AI-powered language and speech models.

Germany

  • Annotate and label text, images, audio, or other data to improve AI systems.
  • Evaluate search results, advertisements, and chatbot responses for quality and accuracy.
  • Create, test, and refine prompts for large language models with Maltese-language insight.

Our partner is a global contributor network that provides flexible remote AI projects focused on annotation, evaluation, and prompt creation. The work is independent, project-based, and aims to improve the accuracy, relevance, and inclusivity of AI systems.

$64,800–$97,200/yr
Germany

  • Translate customer requirements into production-ready AI application configurations.
  • Lead deployments including workflows, data flows, prompts, and guardrails.
  • Build integrations with third-party systems using APIs and webhooks.

They build AI-powered customer communication software. They are a small, fast-moving team focused on production deployments.

  • Follow project-specific guidelines to research and evaluate e-commerce data.
  • Rate the usefulness and relevance of product filters and results based on guidelines.
  • Complete freelance tasks remotely with flexible weekly hours and pay based on tasks completed.

Welo Data is a data annotation and evaluation company supporting AI technology advancement through human intelligence and linguistic expertise. It is part of Welocalize's global network of over 400,000 in-country linguistic resources and offers a multicultural, remote-friendly culture.

US

  • Evaluate software engineering tasks for technical accuracy, realism, and reproducibility.
  • Investigate codebases, tests, and integration issues to identify technical weaknesses.
  • Provide clear, actionable feedback that directly improves AI training and evaluation workflows.

Jobgether is an AI-powered job platform that connects candidates to roles through objective, skill-based matching. It focuses on remote and freelance opportunities, with a data-driven recruitment process and a global candidate pool.

Germany

  • Perform machine translation post-editing (MTPE) on AI-generated translations from English into German for iGaming and poker content.
  • Review translated content for accuracy, tone, and consistency, fixing errors and ensuring natural, player-friendly language.
  • Apply localization quality assurance (LQA) practices and handle HTML and Phrase TMS tags to preserve formatting and technical integrity.

Jobgether is an AI-powered job matching platform that connects top-fitting candidates with hiring companies. The company uses technology to review applications fairly and shares shortlists directly with employers, emphasizing efficiency and data privacy.

Mexico

  • Lead linguistic quality standards for Slovenian content across UI, marketing, product, legal, and support materials.
  • Interface with client Language Managers, manage escalations, and facilitate alignment roundtables.
  • Conduct quality audits, coach reviewers, and deliver monthly quality performance reports.

Jobgether is an AI-powered job matching platform that evaluates candidates against role requirements. It connects top-fitting candidates with hiring companies for remote and contract opportunities.