Source Job

Global

Review brief text-based conversations between users and an AI assistant. Assess user sentiment and identify emotional cues, tone shifts, and contextual signals. Provide clear, concise evaluations based on predefined criteria and offer short written rationales to support your evaluations.

Communication

19 jobs similar to Conversation Sentiment Evaluator

Jobs ranked by similarity.

Global

Review brief text-based conversations between users and an AI assistant. Assess user sentiment: Were they satisfied, neutral, frustrated, confused, or disengaged? Provide clear, concise evaluations based on predefined criteria.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.

US

  • Evaluate agentic and personalized experiences and assess search relevance & recommendations.
  • Create detailed ground truth judgments for music, podcasts, and audiobooks.
  • Adapt quickly as project types rotate and priorities shift and deliver high-quality annotations within 1–2 week deadlines.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.

Europe

  • Contribute to building smarter, more inclusive AI systems.
  • Work on annotation, evaluation, and prompt creation projects.
  • Join a global network of linguists and language enthusiasts.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.

US Canada

  • Review and evaluate AI-generated responses.
  • Rewrite or refine responses when needed.
  • Create natural prompts and dialogues, helping improve the quality of an AI model.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.

$30–$35/hr
Global

  • Evaluate AI-generated Japanese speech and text for linguistic accuracy, naturalness, and educational quality.
  • Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
  • Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.

Alignerr partners with leading AI labs to build expert-driven data pipelines that improve how models reason, learn, and communicate. They work with domain specialists around the world to evaluate and refine AI systems in areas where precision, pedagogy, and human judgment matter most.

$30–$35/hr

  • Evaluate AI-generated Korean speech and text for linguistic accuracy, naturalness, and educational quality.
  • Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
  • Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.

Alignerr collaborates with top AI labs, creating data pipelines driven by experts to enhance AI models' reasoning, learning, and communication. They partner with domain specialists worldwide, perfecting AI systems where precision, pedagogy, and human judgment are crucial.

US Canada

-Review and evaluate AI-generated written responses. -Refine and rewrite responses to improve clarity, tone, and educational quality. -Create natural prompts and example dialogues to support training data needs.

Welo Data is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.

Japan

  • Participate in round-table style discussions about AI tools, including capabilities, weaknesses, cultural alignment, prompt behavior, and model differences.
  • Share real examples of how you use AI - coding, writing, document creation, design support, idea generation, manga/comic development, translation, etc.
  • Evaluate model outputs and provide detailed feedback on issues such as: overly formal or informal tone, incorrect cultural references or mismatched context.

With 27+ years of experience, Welo Data stands as a global leader in high-quality datasets and AI services.

  • Review AI-generated responses and evaluate technical accuracy.
  • Provide expert feedback to train AI systems to write better code.
  • Work with various programming languages and coding challenges.

G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review.

Europe

  • Review and modify machine-generated audio segmentation and transcriptions.
  • Ensure all transcriptions meet quality standards for AI speech-recognition development.
  • Follow detailed project guidelines as an AI Specialist.

CrowdGen is where you will join the CrowdGen Community as an Independent Contractor and help enhance AI-powered speech recognition.

$25–$25/hr
Europe

  • Review and evaluate content to ensure accuracy, clarity, and proper source attribution.
  • Create data and then evaluate the resulting AI-generated content.
  • Read and synthesize content from PDF documents in Finnish.

RWS embraces DEI and promotes equal opportunity; they are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind.

  • Evaluate what AI models produce in your field.
  • -Assess content related to your field of work.
  • -Deliver clear, structured feedback that strengthens the model’s understanding of workplace tasks and language.

Handshake is recruiting Ticket Agents and Travel Clerk Professionals to contribute to an hourly, temporary AI research project—but there’s no AI experience needed.