Source Job

$24–$24/hr
Germany

  • Provide expert rating support and guidance, enhancing the skills of other raters on AI-powered advertising systems.
  • Analyze datasets, identify patterns, and use KPIs to drive data-informed decisions for quality improvements.
  • Collaborate with clients and teams to conduct test rounds, ensure quality benchmarks, and maintain rating proficiency.

Active Listening Google Workspace

20 jobs similar to Expert Rater

Jobs ranked by similarity.

$16–$16/hr
Germany

  • Review and grade internet advertisements to help shape how ads are delivered to end users.
  • Tell the AI program how good or bad its advertisement suggestions are based on user keywords.
  • Work in both Italian and English with a flexible schedule of 5 to 20 hours per week.

Welo Data is an award-winning localization and data transformation company that runs one of the world’s largest Ads Rating Programs. They offer a flexible, self-paced work environment for independent contractors.

  • Review online ads and provide human feedback to improve ad quality and relevance.
  • Evaluate ad matching, language accuracy, and cultural relevance for German-speaking markets.
  • Contribute your human perspective to AI training, working at your own pace.

TELUS Digital enhances AI via human intelligence by providing enriched data through a skilled team of AI specialists and a managed AI community of over one million crowd contributors. They maintain a diverse international culture and support remote work with flexible hours.

Germany

  • Evaluate podcasts in German, focusing on metadata accuracy, explicit content tagging, rights infringement checks, and artwork design quality.
  • Work about 20 hours per month with flexible scheduling.
  • Requires a functional MacBook/Mac device.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train AI systems. We’re building smarter AI with a diverse community in 100+ countries.

US

  • Evaluate simulated advertiser-AI conversations for technical accuracy and campaign structure.
  • Fact-check platform strategies against correct hierarchy and full-funnel metrics.
  • Write clear, actionable feedback to correct errors and improve AI model performance.

RWS specializes in AI training data and language services, providing data annotation and evaluation solutions to improve AI model reliability. The company fosters a culture of diversity and inclusion, operating as a global employer with a focus on equal opportunity.

Australia

  • Annotate or label text, images, or audio to train AI systems
  • Evaluate search results, ads, or chatbot responses for quality and relevance
  • Create and test prompts to improve large language models (LLMs)

Welo Data is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They are building smarter, more human AI with a diverse community in over 100 countries.

UK

  • Evaluate search results and AI-generated content for quality, relevance, accuracy, and usefulness.
  • Apply rating guidelines consistently while maintaining high quality standards and meeting productivity expectations.
  • Participate in training, calibration sessions, and ongoing quality reviews to improve AI model performance.

TELUS Digital enriches data for better AI via human intelligence. They empower generative AI, computer vision, and NLP models with a skilled team and a managed AI community of over one million contributors.

Global

  • Provide native-level Canadian French language vetting and QA for AI data projects.
  • Annotate and review AI outputs for grammatical accuracy, cultural context, and naturalness.
  • Develop educational resources and feedback documentation to improve AI alignment.

We are an AI training company that focuses on language alignment and data annotation for AI systems. Our remote team values linguistic precision and cultural nuance.

Global

  • Evaluate podcasts in Simplified Chinese for metadata accuracy, explicit content, rights infringement, and artwork design.
  • Complete up to 20 hours of work per month using a MacBook/Mac device.
  • Participate in two rounds of interviews and adhere to Client's content guidelines.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train advanced AI systems. They build smarter AI with a diverse community in 100+ countries, emphasizing flexibility, growth, and support.

Brazil

  • Evaluate social media ads for relevance, accuracy, and appropriateness using an external platform.
  • Commit to one hour daily, five days a week, assessing ads on a personal computer.
  • Share insights on ad preferences to improve online advertising strategies.

CrowdGen by Appen connects businesses with a global network of independent contractors to improve AI and digital content. As a large platform, it focuses on flexible, project-based opportunities for remote contributors.

Europe Global

  • Record short audio clips in two native languages following project guidelines.
  • Ensure recordings meet quality, clarity, and accuracy standards.
  • Provide feedback or evaluations on audio samples as needed.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.

Spain

  • Review and grade internet advertisements in German to ensure relevance, accuracy, and effective delivery.
  • Assess ad content and placement against specific criteria and provide feedback for improvement.
  • Conduct keyword research and collaborate with the team to enhance ad targeting and quality.

Welocalize is an award-winning global data and translation company working on tech projects from data localization to generative AI. They have offices across the world and offer structured learning opportunities and long-term partnerships.

South Korea

  • Listen to Korean audio clips and evaluate them against project guidelines.
  • Review metadata and flag sensitive content, explicit language, or undisclosed AI-generated audio.
  • Dedicate up to 20 minutes per task with native Korean proficiency.

Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors delivering high-quality, ethical data to train AI systems. They operate in 100+ countries, focusing on building smarter AI through human contribution.

Global

  • Record short video and/or audio clips in German with various emotional tones.
  • Listen to and transcribe video and/or audio clips accurately.
  • Work remotely on a flexible schedule with a quiet, distraction-free recording environment.

The enterprise client is involved in AI research aimed at helping AI better understand human tone, intent, and emotion. The team is looking for expressive individuals to contribute to video and audio tasks.

Global

  • Evaluate AI-generated text and voice snippets in Punjabi for naturalness and authenticity.
  • Assess audio clips for cultural and tonal accuracy of AI speech.
  • Provide feedback on linguistic nuance and quality of AI outputs.

Prolific builds the biggest pool of quality human data in the world, serving over 35,000 AI developers and researchers. The company connects researchers with paid study participants from diverse backgrounds to gather high-quality, ethically sourced behavioral data.

Global

  • Write prompts in Luxembourgish to test AI models and evaluate responses using a structured rating guide.
  • Identify areas for improvement in AI responses and provide accurate English translations.
  • Work remotely on a flexible schedule with competitive pay.

CrowdGen by Appen is a platform that connects freelancers to help improve AI models through data annotation and evaluation. It is part of a large global company with a diverse community of independent contractors working remotely.

Egypt

  • Label, annotate, and evaluate Arabic photos, graphics, videos, stickers, and designs for linguistic quality and cultural appropriateness.
  • Assess AI-generated content against Canva’s quality bar for Arabic-speaking users.
  • Build and maintain Arabic-specific datasets to support AI feature internationalization.

Canva is an online graphic design platform that enables users to create visual content like social media graphics and presentations. With thousands of employees globally, the company fosters a culture of innovation, collaboration, and inclusion.

Canada

  • Review search queries with personalized results based on your activity history.
  • Evaluate suggested places, such as restaurants or locations, related to places you've previously visited.
  • Rate the relevance and usefulness of suggested places and follow project guidelines.

Welo Data provides AI services, including data annotation and evaluation for machine learning models. They operate with a freelance workforce and focus on quality and accuracy in digital experiences.

Italy

  • Record 150 short, scripted voice prompts in Italian using the Appen Mobile app on your smartphone.
  • Work from anywhere in Italy on your own schedule, with the task taking approximately 2 hours.
  • Must be a native Italian speaker, currently residing in Italy, and 18+ years old with a compatible smartphone.

CrowdGen by Appen is a platform that connects independent contractors with AI data collection projects. They are a large company focused on gathering high-quality speech data to improve voice AI systems, with a culture of flexible, project-based work.

Global

  • Listen to short audio clips in Panamanian Spanish and evaluate them based on project criteria.
  • Identify characteristics of Panamanian Spanish and compare recordings to determine which sounds most natural.
  • Apply evaluation guidelines consistently and maintain high quality standards within deadlines.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world's most advanced AI systems. They offer project-based opportunities with flexible, remote work and a supportive global community.

Portugal

  • Utilize Automatic Prompt Generation and Automated Prompt Optimization tools to create and refine prompts for LLM autoraters.
  • Monitor shadowbot runs, ensure sufficient disagreements, and measure autorater quality using accuracy metrics like F1 scores.
  • Draft technical launch readiness justifications and handle edge-case scenarios by designing manual prompts.

Welo Data provides AI data validation services for global clients. As a freelance and remote employer, it offers flexible project-based roles with a focus on technical AI workflows.