Source Job

Global

  • Own day-to-day execution for annotation queues on a live AI training/eval program.
  • Run quality calibrations, monitor contributor performance, and resolve bottlenecks.
  • Build dashboards that give stakeholders real-time visibility into throughput and quality.

Quality Assurance Data Annotation SQL

14 jobs similar to Queue Lead

Jobs ranked by similarity.

$104,000–$170,400/yr
Global

  • Own end-to-end quality and delivery for Human Data projects, personally reviewing work to ensure accuracy and consistency.
  • Lead, coach, and performance-manage a team of AI Tutors, conducting regular reviews and driving continuous improvement.
  • Drive efficiency by identifying operational bottlenecks, implementing process improvements, and tracking performance via KPIs.

SpaceXAI creates AI systems that can understand the universe and aid humanity's pursuit of knowledge. The team is small, highly motivated, and focused on engineering excellence with a flat organizational structure.

Netherlands

  • Lead and coach a team of AI Tutors while staying hands-on with reviewing, evaluating, and improving technical work.
  • Establish quality standards, monitor KPIs, and implement scalable improvements across data labeling and annotation workflows.
  • Partner with data and engineering stakeholders to translate AI model requirements into effective operational strategies.

They build and maintain high-quality human-generated data that supports advanced AI model development. The company has a fast-paced, collaborative, and highly autonomous culture focused on technical excellence and continuous improvement.

Spain

  • Own end-to-end quality and delivery for Human Data projects, reviewing work and managing performance.
  • Coach and develop AI Tutors, conduct regular reviews, and implement process improvements.
  • Collaborate with Human Data Managers and Engineering to translate model requirements into labeling strategies.

Our partner is a company that produces and evaluates high-quality human data to support the development of advanced AI systems. They are part of a collaborative, engineering-focused environment with a distributed team, emphasizing initiative and ownership.

$145,000–$175,000/yr
US

  • Design and execute technical training programs for AI data and annotation teams, including curricula and certifications.
  • Own quality frameworks, monitor KPIs like accuracy and defect rates, and drive continuous improvement.
  • Provide technical guidance for AI data projects such as LLM evaluation, RLHF, and model benchmarking.

Innodata is a global data engineering company that provides data, evaluation frameworks, and human expertise for AI systems. With over 36 years of experience, they are committed to delivering the highest quality data and outstanding outcomes for clients.

$104,000–$170,400/yr
Canada

  • Lead a team producing high-quality training data and evaluations for advanced AI models.
  • Review engineering-domain work, uphold quality standards, and drive operational improvements.
  • Coach and develop AI Tutors while collaborating with engineering and human data teams.

Jobgether is an AI-powered job platform that connects candidates with partner companies using objective matching. This role is with a partner company focused on AI training data, offering a collaborative, remote-first environment emphasizing autonomy and continuous learning.

$104,000–$170,400/yr
US

  • Lead a team of AI Tutors to create high-quality medical training data for advanced AI systems.
  • Apply hands-on medical expertise to review work, ensure quality, and improve operations.
  • Partner with engineering to translate AI model requirements into effective labeling strategies.

The company is a partner organization focused on producing high-quality training data for advanced AI systems. It operates as a globally distributed team with a collaborative, high-autonomy culture.

India

  • Leads program strategy and delivery for AI training data projects, owning client relationships and governance.
  • Manages cross-functional teams, capacity, budgets, and quality outcomes with the Lead Quality Manager.
  • Drives process improvement, automation, and risk management to meet high-volume operational targets.

Welo Data is the multilingual data and evaluation partner for companies deploying GenAI systems globally. It has a global network of 500,000+ vetted experts across 300+ languages to ensure reliable AI model performance.

$104,000–$170,400/yr
Global

  • Lead a team of AI Tutors to deliver high-quality training data and evaluations for SpaceXAI's models.
  • Own end-to-end quality and delivery for Human Data projects, reviewing work and ensuring consistency.
  • Coach, performance-manage, and develop talent while improving operational processes.

SpaceXAI creates AI systems to understand the universe and aid humanity. The team is small, highly motivated, and focused on engineering excellence with a flat structure.

Global

  • Review text or media samples based on provided project guidelines
  • Apply accurate labels and categorizations to diverse data sets
  • Evaluate AI-generated responses for clarity, safety, and factual accuracy

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Americas Asia

  • Lead a new global sourcing hub for complex AI projects requiring specialized or hard-to-reach talent.
  • Design and execute creative sourcing strategies with Recruitment and Delivery teams.
  • Use data, AI, and automation to improve sourcing efficiency and scalability.

Appen is an AI training data leader, providing human-generated data for AI models across generative AI, LLMs, and more. Its platform and global crowd of over 1 million contributors support model development, with a culture of innovation and collaboration.

Brazil 7w PTO 18w maternity 18w paternity

  • Lead a remote customer support team during night shifts to achieve operational excellence and resolve complex cases.
  • Use data-driven analysis to optimize team performance and identify process improvements through cross-functional collaboration.
  • Foster a culture of growth and wellbeing by mentoring team members, providing feedback, and promoting inclusive leadership.

Wise is a global technology company building the best way to move and manage money across borders. With a diverse team of over 5,000 employees, they foster a mission-driven, inclusive culture focused on innovation and customer savings.

$72,000–$85,000/yr
US Unlimited PTO 16w maternity 8w paternity

  • Lead, coach, and develop a team of Member Service Representatives to deliver exceptional member experiences.
  • Manage daily operations, including real-time queue management and quality assurance through call audits and calibrations.
  • Track performance metrics and drive continuous improvement using data from Salesforce, Zendesk, and Talkdesk.

Twin Health empowers people to prevent and reverse chronic metabolic diseases like type 2 diabetes using AI Digital Twin technology. The company is scaling rapidly with over $100 million in funding and has been named one of Newsweek's Top Most Loved Workplaces.

$70,000–$70,000/yr
US

  • Own real-time support queue monitoring, staffing coverage, and ticket flow to prevent backlogs.
  • Write and maintain SOPs and Confluence documentation for support processes and best practices.
  • Act as the go-to SME, coach the team, handle escalations, and jump on tickets when needed.

O.R. TRAX is a healthcare SaaS company that automates vendor management and surgical scheduling for hospitals and ambulatory surgery centers. The company is fast-growing and execution-driven, supporting hundreds of hospitals with zero-hardware deployment and enterprise-scale reliability.

Americas

  • Design AI evaluations: define ground truth, metrics, and scoring methods for models and agents.
  • Build repeatable eval loops to track quality over time and catch regressions before release.
  • Translate eval results into actionable recommendations for system improvements.

Alpaca is a global leader in agent-first brokerage infrastructure, providing APIs for stocks, ETFs, options, crypto, and more. We're a diverse team of 400+ remote-first members backed by $400M in funding, committed to opening financial services to everyone.