AI Evaluators: Assessing A Shopping Assistant

What We're Researching:

• We're hiring AI evaluators to assess the accuracy and helpfulness of a new digital shopping assistant.
• This project focuses on understanding how well the system handles real-world e-commerce queries and where it falls short in its logic.
• Your analysis will directly feed into improving the underlying model and its response quality.

How It Works:

• You will review real interaction traces between users and the shopping assistant within our custom platform.
• As you analyze these conversations, you will pinpoint specific failures, logical errors, or unhelpful product recommendations.
• From there, you will create structured rubrics and verifiers to consistently judge future response quality.

Who This Is For:

• This opportunity is ideal for quality assurance specialists, AI data evaluators, and e-commerce professionals with a strong eye for detail.
• We welcome applicants with prior experience in prompt engineering, complex data annotation, or software testing.
• You should be comfortable analyzing text interactions deeply and building structured evaluation frameworks from scratch.