Entertainment Media Content Rater

About The Role:

• Review and evaluate model-generated responses to user queries about entertainment media.
• Ensure adherence to project-specific guidelines and rubric dimensions.
• Verify contributors apply instructions, constraints, and evaluation criteria.

What You Will Do:

• Confirm contributors accurately identify factual errors or missing information.
• Ensure contributor-selected options align appropriately with rubric dimensions.
• Provide detailed feedback on contributor performance.

Requirements:

• Proven expertise in film and media studies.
• Strong familiarity with narrative structures and contextual and cultural references.
• Proven experience in AI data annotation and evaluating content using structured grading criteria.

Project Details:

• Duration until March 20th.
• Job Type: Freelance.
• Expected capacity: 20 hours per week.