Similar Jobs
See allAudio Rater - Generalist - English (Canada)
Welo Data
Canada
Listening
Attention To Detail
Written Communication
Audio Rater - Generalist - English (New Zealand)
Welo Data
New Zealand
Listening
Attention To Detail
Communication
Audio Rater - Generalist - English (United Kingdom)
Welo Data
UK
Listening
Attention To Detail
Written Communication
Audio Rater - Generalist - English (Australia)
Welo Data
Australia
Listening
Attention To Detail
Written Communication
New AI Voice Evaluation Specialist
Innodata
US
Listening
Communication
Critical Thinking
Overview:
- We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents.
- You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.
Responsibilities:
- Listen carefully to recorded conversations between a person and an AI voice agent.
- Rate each of the agent's turns on two independent 1–5 scales: Content and Prosody.
- Write a short, specific, and clear justification for each score given.
Qualifications:
- Strong listening and attention-to-detail skills.
- Ability to give consistent, well-reasoned ratings.
- Clear, concise written communication and reliable availability for ~10 hours/week.
Welo Data
Welo Data provides AI services, specializing in data annotation and evaluation for machine learning models. As a global company, they offer freelance opportunities for detail-oriented contractors to support AI development projects.