Similar Jobs
See allAI Evaluators: Assessing A Shopping Assistant
Partner Company
US
Data Evaluation
Quality Assurance
Critical Thinking
Generative Audio Evaluation - Spanish (Mexico)
RWS
Mexico
Spanish
Attention To Detail
Listening
Javanese Speakers - Test Voice Modes of AI Models
Jobgether
Ireland
English
Attention To Detail
Listening
AI Evaluators: Assessing A Shopping Assistant
Terac
Global
Data Evaluation
Quality Assurance
Analytical Skills
New Content Evaluator – Bilingual (Vietnamese and English)
Innodata
United States
Customer Service
English
Analytical Skills
Responsibilities:
- Review assigned scenario and roleplay natural conversations with two AI models, ensuring consistency in approach and turn count.
- Record voice interactions and evaluate responses across five quality dimensions.
Evaluation:
- Identify and categorize error clusters, compare model performance, and select the stronger model.
- Write clear, objective rationale with specific examples from both conversations.
Requirements:
- Bachelor's degree and strong attention to detail, listening, and writing skills.
- Ability to follow guidelines and speak naturally in roleplay scenarios.
Compensation:
- Hourly rate of $20–$27, based on experience, skills, and qualifications.
Innodata
Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise. With a 36+ year legacy, they deliver high-quality data and outcomes for AI builders and adopters.