Review brief text-based conversations between users and an AI assistant. Assess user sentiment and identify emotional cues, tone shifts, and contextual signals. Provide clear, concise evaluations based on predefined criteria and offer short written rationales to support your evaluations.
Source Job
19 jobs similar to Conversation Sentiment Evaluator
Jobs ranked by similarity.
Review brief text-based conversations between users and an AI assistant. Assess user sentiment: Were they satisfied, neutral, frustrated, confused, or disengaged? Provide clear, concise evaluations based on predefined criteria.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.
- Evaluate agentic and personalized experiences and assess search relevance & recommendations.
- Create detailed ground truth judgments for music, podcasts, and audiobooks.
- Adapt quickly as project types rotate and priorities shift and deliver high-quality annotations within 1–2 week deadlines.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.
- Contribute to building smarter, more inclusive AI systems.
- Work on annotation, evaluation, and prompt creation projects.
- Join a global network of linguists and language enthusiasts.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.
- Review and evaluate AI-generated responses.
- Rewrite or refine responses when needed.
- Create natural prompts and dialogues, helping improve the quality of an AI model.
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.
- Shape the future of AI using high-quality language data.
- Work on freelance projects involving Annotation, Evaluation, and Prompt creation.
- Be part of global projects with real-world impact.
Welo Data is at the frontier of AI and localisation, providing high-quality language data that fuels smarter, more inclusive technologies.
- Evaluate AI-generated Japanese speech and text for linguistic accuracy, naturalness, and educational quality.
- Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
- Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.
Alignerr partners with leading AI labs to build expert-driven data pipelines that improve how models reason, learn, and communicate. They work with domain specialists around the world to evaluate and refine AI systems in areas where precision, pedagogy, and human judgment matter most.
- Review and modify machine-generated audio segmentation and transcriptions.
- Ensure all transcriptions meet quality standards for AI speech-recognition development.
- Follow detailed project guidelines as an AI Specialist
Appen provides or collects the data for machine learning.
- Evaluate AI-generated Korean speech and text for linguistic accuracy, naturalness, and educational quality.
- Assess learner speech and writing across proficiency levels from CEFR Pre-A1 through B2+.
- Apply expert judgment to identify learner errors, unnatural phrasing, and pedagogical gaps.
Alignerr collaborates with top AI labs, creating data pipelines driven by experts to enhance AI models' reasoning, learning, and communication. They partner with domain specialists worldwide, perfecting AI systems where precision, pedagogy, and human judgment are crucial.
-Review and evaluate AI-generated written responses. -Refine and rewrite responses to improve clarity, tone, and educational quality. -Create natural prompts and example dialogues to support training data needs.
Welo Data is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.
- Participate in round-table style discussions about AI tools, including capabilities, weaknesses, cultural alignment, prompt behavior, and model differences.
- Share real examples of how you use AI - coding, writing, document creation, design support, idea generation, manga/comic development, translation, etc.
- Evaluate model outputs and provide detailed feedback on issues such as: overly formal or informal tone, incorrect cultural references or mismatched context.
With 27+ years of experience, Welo Data stands as a global leader in high-quality datasets and AI services.
- Help improve AI by reviewing videos and judging how similar they are.
- Your work helps AI make better and more accurate video evaluations.
- Follow a step-by-step, rule-based workflow.
CrowdGen, by Appen, is a company offering project-based opportunities. The role is a project-based opportunity where you will join as an Independent Contractor.
- Record a total of 28 short videos across 2 sessions (14 videos per session).
- Perform simple, guided micro-actions following provided instructions.
- Record videos under both normal and adversarial conditions as required.
CrowdGen by Appen offers project-based opportunities. In this role, you join as an Independent Contractor.
- Review AI-generated responses and evaluate technical accuracy.
- Provide expert feedback to train AI systems to write better code.
- Work with various programming languages and coding challenges.
G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review.
- Review and modify machine-generated audio segmentation and transcriptions.
- Ensure all transcriptions meet quality standards for AI speech-recognition development.
- Follow detailed project guidelines as an AI Specialist.
CrowdGen is where you will join the CrowdGen Community as an Independent Contractor and help enhance AI-powered speech recognition.
Contribute to AI technology’s speech recognition. Collect audio recordings with various accents. Conduct all tasks in English.
Contribute directly to the future of AI in your language.
- Review agent-caller conversation transcripts.
- Evaluate and label entity types according to Task Guidelines.
- Complete tasks accurately and consistently.
- Review and evaluate content to ensure accuracy, clarity, and proper source attribution.
- Create data and then evaluate the resulting AI-generated content.
- Read and synthesize content from PDF documents in Finnish.
RWS embraces DEI and promotes equal opportunity; they are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind.
- Record short videos of unique mannequins.
- Complete up to 10 short mannequin clips per participant.
- Use the Appen Mobile app to submit recordings.
CrowdGen is helping to build the next generation of fraud-detection AI. CrowdGen is part of Appen and provides opportunities for flexible participation and project-based roles.
- Evaluate what AI models produce in your field.
- -Assess content related to your field of work.
- -Deliver clear, structured feedback that strengthens the model’s understanding of workplace tasks and language.
Handshake is recruiting Ticket Agents and Travel Clerk Professionals to contribute to an hourly, temporary AI research project—but there’s no AI experience needed.