Similar Jobs
See allProject Specialist
Appen
Spain
Data Annotation
Cross-functional Communication
Data Analysis
Annotation Program Manager
Gather AI
India
Python
Jira
Player Experience and Safety Lead
Everskies
Global
Trust & Safety
Content Moderation
Team Management
Data Annotation Specialist
Cohere
Canada
Data Annotation
LLM Evaluation
Content Moderation
Worker Operations Team Lead
Clipboard
US
Coaching
People Management
Customer Support
Queue Operations & Task Management:
- Manage work queue: intake, triage, prioritization, task assignment, and SLA delivery.
- Monitor task queue and backlog control.
- Identify and troubleshoot bottlenecks (unclear policy, tooling issues, supply gaps).
Quality Assurance & Performance Management:
- Perform QA: make corrections, provide annotator feedback, flag systematic confusion.
- Monitor quality at project and individual annotator levels.
- Drive guideline adherence, run calibration sessions, reduce rework.
Training & Support:
- Train new annotators on project guidelines.
- Conduct live or recorded webinars as participants join a project.
- Host office hours and oversee dedicated Slack channels for participant support.
Metrics & Continuous Improvement:
- Track key metrics: throughput, disagreement rates, defect/rework rates.
- Provide feedback for process improvements.
- Ensure predictable SLA delivery and stable backlog with improving quality.
Prolific
Prolific is building the world's largest pool of quality human data for AI development, serving over 35,000 AI developers, researchers, and organizations. They focus on ethically sourced behavioral data to enhance AI systems, fostering a culture of quality and innovation.