Similar Jobs
See allSearch Quality Rater
Welo Data
United States
English Fluency
Attention To Detail
Computer Literacy
Humanities / Arts / Culture Evaluator
Partner Company
Canada
Critical Thinking
Analytical Skills
Written Communication
AI Agent Evaluator
Hippocratic AI
US
Written Communication
Privacy / Regulatory Compliance Evaluator
Partner Company
India
Privacy
Regulatory Compliance
Data Protection
AI Response Labeler / Annotator
Jobgether
US
English
Analytical Skills
Attention To Detail
ABOUT THE ROLE:
- Turn complex customer policies into consistent evaluations of AI model behavior.n- Balance policy text and intent with customer expectations and context.n- Work on varied subject matters from safety to emotional support to sexual-safety policy.
WHAT YOU WILL DO:
- Learn new policies and evaluation rubrics quickly.
- Write concise, evidence-based rationales citing policy and conversation details.n- Identify policy gaps and participate in calibration discussions.
YOU MAY BE A FIT IF:
- You enjoy making precise distinctions between subtle differences.
- You can separate personal views from customer policy standards.
- You communicate clearly and treat sensitive material with maturity.
Handshake
Handshake powers a platform connecting 25 million job seekers with employers and educational institutions. Through Handshake AI, they provide data to frontier AI labs, having grown to a ~$1B run rate and paying over 30K individuals monthly.