Similar Jobs
See allAI Evaluators: Assessing A Shopping Assistant
Terac
Global
Data Evaluation
Quality Assurance
Analytical Skills
AI Interaction Evaluator (Codex / Claude Code)
Jobgether
US
Python
TypeScript
JavaScript
Customer success / support operations Evaluator India
Partner Company
India
Customer Success
Customer Support
Support Operations
Document / Deck Production QA Evaluator
Jobgether
Canada
Quality Assurance
Microsoft Office
Google Workspace
Domain Advisor Consultant (Subject Matter Expert)
Partner Company
US
Analytical Reasoning
Written Communication
Independent Work
About the Role:
- Evaluate AI-powered shopping assistant interactions for accuracy and usefulness.
- Provide structured feedback to improve model performance.
Key Responsibilities:
- Review real user interaction traces and identify logical failures.
- Analyze response quality from an e-commerce perspective.
- Create rubrics and verifiers for consistent evaluation.
Requirements:
- Experience in data evaluation, quality assurance, or AI training.
- Strong analytical skills and attention to detail.
- Familiarity with e-commerce search and shopping journeys.
Benefits:
- Compensation of $50 per hour.
- Fully remote work from within the United States.
- Sustained part-time engagement of 20+ hours per week.
Partner Company
The partner company is developing an AI-powered digital shopping assistant and seeks evaluators to assess and improve its responses. The team size and culture are not specified.