Source Job

20 jobs similar to Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops)

Jobs ranked by similarity.

Spain India Philippines EU

  • Coordinate assigned project workstreams to ensure on-time delivery against execution standards.
  • Partner with client teams to validate quote assumptions, analyze datasets for insights, and provide data-backed findings.
  • Maintain version control and translate QA findings into targeted improvements to reduce recurring annotation errors.

Appen has been a leader in AI training data for over 30 years, specializing in human-generated data to train, fine-tune, and evaluate models across generative AI, large language models, computer vision, and speech recognition. With a global crowd of over 1 million contributors in more than 200 countries, the company fosters a culture of innovation, collaboration, and excellence.

India

  • Own day-to-day management of annotation vendor relationships, including workload planning and SLA management.
  • Monitor annotation quality and improve labeling accuracy through structured QA processes.
  • Build and maintain Python-based workflows for data preparation, API integrations, and validation.

We are building a vision-powered platform that uses autonomous drones to digitize warehouse workflows, making operations smarter and safer. Our engineering team is fast-moving, technically deep, and each individual contributor carries real accountability.

Global

  • Own and enforce Rules of Conduct, punishment framework, and escalation policies for platform safety.
  • Monitor support queue health, response times, and provide performance feedback to agents.
  • Lead a collaborative team bridging Trust & Safety and Support, and communicate community insights to product team.

Everskies is an online pixel doll platform for Gen Z, with a community that values creativity and expression. The team is small, fast-moving, and focused on keeping the platform safe and inclusive.

$22–$22/hr
Canada

  • Evaluate and rank model outputs, stress-test models for failure modes, and create high-quality datasets with detailed rubrics.
  • Annotate and correct multimodal data, maintain consistency through calibration exercises, and adapt to evolving task types.
  • Report on model performance trends and provide clear feedback to cross-functional partners on model successes and failures.

Cohere is a security-first enterprise AI company that builds cutting-edge foundation models and end-to-end products for real-world business problems. It is a global technology company with offices in Toronto, San Francisco, London, New York, Montreal, Seoul, Germany, and Paris, staffed by a team of passionate researchers, engineers, and designers.

US

  • Monitor agent performance in quality, productivity, and attendance with a focus on QA scores above 9%.
  • Provide frequent coaching based on QA feedback, metrics, and ticket observations.
  • Handle escalations, maintain coaching logs, and ensure schedule adherence.

Clipboard operates an app-based marketplace connecting healthcare professionals with workplaces needing staff. Founded in 2016, the remote-first team of over 1,000 has been profitable since 2022 and is a top Y-Combinator company.

$4–$5/hr
Global

  • Review AI-generated responses against source images and quality guidelines.
  • Identify issues like hallucinations, missing details, or policy violations.
  • Provide structured feedback to improve model performance and output quality.

Jobgether uses AI-powered matching to connect candidates with partner companies. They focus on efficient, objective hiring processes and operate as a platform for remote opportunities.

US 4w PTO

  • Lead day-to-day support engineering operations, including team meetings, metrics tracking, and OKR progress.
  • Own queue health, manage escalations, and coordinate with Tier2, Engineering, and Product stakeholders.
  • Design schedules, conduct QA checks, and drive continuous improvement through CSAT feedback and playbooks.

n8n is an open workflow orchestration platform built for the new era of AI, giving technical teams the freedom of code with the speed of no-code. Since 2019, we've grown into a diverse team of over 260 across Europe and the US, backed by Sequoia and SAP, and we cultivate a community of over 650,000 active developers.

$91,440–$121,920/yr
UK

  • Manage key Trust & Safety programs to reduce harmful experiences for users.
  • Collaborate cross-functionally to identify and mitigate risks across products and services.
  • Apply data-driven frameworks to assess program effectiveness and drive improvements.

Mozilla is a non-profit-backed technology company that creates products like Firefox to shape a better internet. With over 225 million monthly users, the company operates with a mission-driven culture and is owned by the non-profit Mozilla Foundation.

Japan

  • Lead a team of Quality Control Reviewers to ensure consistent quality standards for the Japanese locale.
  • Review and audit feedback to ensure alignment with project guidelines.
  • Act as the primary quality point of contact for the Japanese locale.

Welo Data provides AI training data and quality services to improve AI systems. They are a remote-first company focused on language quality and team collaboration.

$100,000–$100,000/yr
US Unlimited PTO

  • Own the daily health of the support queue and enforce SLA targets.
  • Coach and develop a team of agents through structured QA and feedback cycles.
  • Collaborate with cross-functional teams to drive product readiness and escalation resolution.

First Due provides end-to-end software solutions for fire and EMS agencies to improve safety and operations. Over 3,000 agencies and 500,000 first responders use its platform, and it is FedRAMP High certified.

$108,000–$162,000/yr
Global

  • Own end-to-end quality and delivery for critical Human Data projects while ensuring accuracy, consistency, and guideline adherence at scale.
  • Lead, coach, and grow a team of Team Leads and AI Tutors, including performance management, career development, and talent pipeline building.
  • Collaborate with Program Staff, Go-to-Market, and Engineering teams to translate model needs into data requirements and labeling strategies.

SpaceXAI creates AI systems to understand the universe and aid humanity. The team is small, highly motivated, and focused on engineering excellence with a flat organizational structure.

$49,680–$66,960/yr
Europe

  • Lead end-to-end forecasting, capacity planning, and scheduling for internal and BPO support teams.
  • Monitor real-time performance and manage intraday workforce adjustments to meet SLA targets.
  • Oversee BPO SLA adherence, operational reporting dashboards, and drive automation initiatives.

Airalo is the world's first eSIM store, helping people connect in over 200+ countries and regions. Our team is spread across 50+ countries and six continents, and we are an equal-opportunity environment committed to diversity and inclusion.

Global

  • Supervise and coordinate daily classification/labeling activities for a team of 8-15 content labeling associates.
  • Monitor employee performance, provide weekly feedback, and implement improvement plans as needed.
  • Foster a culture of teamwork and continuous improvement through daily stand-ups, calibration sessions, and open communication.

DoubleVerify is a leading software platform for digital media measurement and analytics. The company employs a diverse team of associates, QA professionals, and leads, fostering a culture of passion, accountability, collaboration, and trailblazing (PACT).

US Canada

  • Define and evolve the centralized quality assurance strategy across customer support channels including email, chat, messaging, and voice.
  • Analyze QA results, customer interactions, and performance data to identify coaching opportunities and process improvements.
  • Partner with cross-functional teams to drive operational improvements, enhance customer experience, and shape AI-powered support workflows.

1Password is a cybersecurity company that provides password management and unified access management solutions, trusted by over 180,000 businesses including Fortune 100 leaders. With a culture of collaboration, transparency, and continuous improvement, the company has been recognized on the Forbes Cloud 100 for four years in a row.

Sweden

  • Review completed tasks from trainers, including questions, images, and golden answers, to ensure accuracy and consistency.
  • Independently verify golden answers based on images and flag errors, inconsistencies, or ambiguities.
  • Provide clear feedback and track error patterns to maintain high data quality and escalate unclear cases.

Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors delivering high-quality, ethical data to train advanced AI systems. They operate in 100+ countries, offering flexible remote work and growth opportunities.

Spain

  • Lead and support a team of approximately 10 Quality Control Reviewers, ensuring consistent quality standards across the Spanish (Spain) locale.
  • Act as the primary quality point of contact for the Spanish (Spain) locale, resolving quality questions and escalating complex issues when necessary.
  • Conduct calibration sessions and provide structured coaching to improve reviewer performance.

Welo Data provides data quality services for AI training programs, focusing on linguistic quality and annotation. The team is dedicated to improving AI systems through rigorous quality assurance and collaboration.

Turkey

  • Annotate and review multimedia data (video, images, metadata) using defined labeling rules and guidelines.
  • Perform self-QA, track recurring issues, and contribute to guideline improvements with clear documentation.
  • Collaborate with stakeholders to meet throughput and quality targets while participating in calibration sessions.

Welo Data provides AI services, specializing in data annotation and quality review for multimedia content. As a growing remote team, we offer freelance opportunities for detail-oriented professionals to enhance global AI systems.

US

  • Lead a seasonal team of 30 Print Quality Resolution Assistants and 2 Specialists, ensuring premium customer experience and high print quality standards.
  • Manage real-time phone queues, adjust staffing to meet service levels, and partner with Workforce and Print Quality teams on policy and training.
  • Monitor team case data in Salesforce, surface trends to leadership, and provide regular performance updates on quality metrics and CSAT.

Minted operates a marketplace empowering independent artists to sell and scale their work, connecting them with a global audience. The company is headquartered in San Francisco, employs over 350 full-time employees plus seasonal workers, and has raised over $300M from top-tier investors.

$90,000–$115,000/yr
US

  • Lead proactive risk mitigation and quality governance to identify systemic issues before they escalate.
  • Manage high-stakes escalations and incident response with a team of resolution specialists.
  • Drive cross-functional root-cause analysis and process improvements to enhance customer experience.

Human Interest is a fintech company that provides retirement benefits for small and medium-sized businesses. It is a high-growth company backed by top investors, with a culture focused on customer obsession and long-term orientation.

US

  • Lead and manage the trust and safety operations for TrevorSpace, an online safe-space social network for LGBTQ+ young people, ensuring world-class enforcement standards and policy compliance.
  • Act as the ultimate escalation authority in a 24/7/365 environment, handling live crises and high-stakes incidents with decisive action.
  • Partner cross-functionally with legal, policy, technology, and communications teams to govern platform safety, develop SOPs, and drive automated moderation solutions.

The Trevor Project is the leading suicide prevention and crisis intervention organization for LGBTQ+ young people. For over 25 years, we have been saving lives through crisis services, research, advocacy, education, and peer support programs.