Source Job

$60,000–$80,000/yr
US Unlimited PTO

  • Review and annotate audio and video content to support fraud detection, authentication, and deepfake detection technologies.
  • Apply classification criteria to identify fraud indicators, synthetic content, and other attributes while maintaining high-quality datasets.
  • Document observations and collaborate with Research Scientists to resolve edge cases and support model improvements.

Data Annotation Spreadsheets Attention To Detail SQL

20 jobs similar to Audio Annotation Analyst

Jobs ranked by similarity.

$31–$31/hr
Canada

  • Audit 30% of production output to ensure rating quality and consistency during the pilot phase.
  • Identify and flag miscalibration or inconsistent scoring across raters.
  • Provide clear, actionable feedback and corrections to raters to maintain alignment.

Welo Data provides AI services, focusing on data annotation and quality assurance for machine learning models. They are a global freelance community with a collaborative, independent culture.

$25–$25/hr
UK

  • Audit 30% of production output during the initial pilot phase to ensure rating quality and consistency.
  • Identify and flag miscalibration or inconsistent scoring across raters, providing clear feedback.
  • Complete onboarding and training ahead of the production pool's rollout while working independently.

Welo Data is an AI services company that provides data annotation and quality assurance for AI projects. They are a growing community of freelancers and contractors, fostering a remote work culture with a focus on accuracy and consistency.

$29–$29/hr
US

  • Audit 30% of production output to identify and flag miscalibration or inconsistent scoring across raters.
  • Provide clear, actionable feedback and corrections to raters to ensure rating quality and consistency.
  • Complete onboarding and training ahead of the production pool's rollout to maintain alignment.

Welo Data provides AI services, specializing in data annotation and quality assurance for machine learning projects. They are a growing company focused on building a community of freelance raters and testers, offering flexible remote work opportunities.

$38–$38/hr
Australia

  • Audit 30% of production output to ensure rating quality and consistency during the initial phase.
  • Identify miscalibration or inconsistent scoring across raters and flag issues early.
  • Provide clear, actionable feedback and corrections to raters to maintain alignment.

Welo Data provides AI services and data solutions for machine learning and artificial intelligence projects. They are a growing community of freelancers and contractors working on various AI-related tasks.

Global

  • Review text or media samples based on provided project guidelines
  • Apply accurate labels and categorizations to diverse data sets
  • Evaluate AI-generated responses for clarity, safety, and factual accuracy

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

New Zealand

  • Audit 30% of production output during the pilot phase to ensure rating quality and consistency.
  • Identify and flag miscalibration or inconsistent scoring across raters.
  • Provide clear, actionable feedback and corrections to raters.

Welo Data provides AI services, including data annotation and rating for machine learning projects. It is a community of freelancers working on various AI-related tasks.

Philippines India

  • Review flagged annotations and resolve disagreements on word-level transcription and timestamps.
  • Listen to audio clips and make final determinations on segment boundaries and transcriptions.
  • Apply the project style guide consistently and provide clear rationale for adjudication decisions.

Welo Data provides AI services including data annotation and transcription for machine learning projects. As part of Welo Global, it works with a freelance/contract workforce to support AI training with human expertise.

India Philippines

  • Review pre-segmented audio recordings and verify word-level segment accuracy for speech-to-speech AI model training.
  • Correct timestamp or transcription errors and flag tasks for discard per defined criteria.
  • Maintain consistency and accuracy across a detailed, evolving style guide.

Welo Data provides AI services, including data annotation and labeling for machine learning models. As part of the AI Services team, they focus on supporting speech-to-speech AI model training with accurate transcription and audio review.

Australia

  • Listen carefully to recorded conversations between a person and an AI voice agent.
  • Rate each of the agent's turns on two independent 1–5 scales for content and prosody.
  • Write a short, specific, and clear justification for each score given.

Welo Data provides AI services, specializing in evaluating and improving AI voice agents. They are a growing community of freelancers focused on data quality and human-in-the-loop tasks.

UK

  • Listen to recorded conversations between users and AI voice agents to evaluate response quality.
  • Rate each agent turn on two scales: content helpfulness and prosody naturalness.
  • Write short, specific justifications for each score given.

Welo Data is an AI services company that provides evaluation and data services for AI voice agents. They are a global organization with a freelance workforce, focusing on quality assessment of AI interactions.

New Zealand

  • Evaluate conversations between users and AI voice agents by listening to recorded interactions.
  • Rate each AI agent turn on two 1-5 scales: content quality and prosody naturalness.
  • Provide clear, specific written justifications for each rating given.

Welo Data provides AI services, specializing in data evaluation and human feedback for AI systems. They are an established company with a global community of freelancers and a focus on remote, collaborative work.

Canada

  • Design and conduct realistic role-play scenarios for AI evaluation in travel, finance, and technical support.
  • Evaluate AI-generated audio conversations for accuracy, naturalness, and task completion.
  • Assess basic programming literacy and generate high-quality audio evaluation datasets.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. This freelance AI trainer project focuses on evaluating conversational AI through realistic audio interactions, offering a flexible remote work environment for independent contractors.

Global

  • Review and annotate high-resolution scans of international IDs to identify microscopic markers of forgery or tampering.
  • Evaluate liveness test data to help AI detect deepfakes, playback attacks, or 3D masks during face-matching.
  • Act as a fraudster by testing the system with edge-case documents and synthetic identities to find KYC model vulnerabilities.

TELUS Digital builds the 'Shield of Trust' for global digital identity by training AI to detect fraud and verify identity documents. With over one million contributors worldwide, they offer a flexible, remote community focused on innovation and impact.

Ireland

  • Audit 30% of production output during the pilot phase to ensure rating quality and consistency.
  • Identify and flag miscalibration or inconsistent scoring across raters.
  • Provide clear, actionable feedback and corrections to raters.

Welo Data provides AI services and general application support. They are a freelance-oriented company focused on data quality and AI training projects.

US

  • Evaluate conversations between users and AI voice agents for content quality and prosody.
  • Rate each AI agent turn on a 1–5 scale and provide written justification.
  • Maintain consistent, well-reasoned ratings with strong attention to detail.

Welo Data provides AI services, specializing in data annotation and evaluation for machine learning models. As a global company, they offer freelance opportunities for detail-oriented contractors to support AI development projects.

Europe

  • Annotate and label text, images, audio, or other content for AI training projects.
  • Evaluate AI-generated content for quality, relevance, accuracy, and overall usefulness.
  • Create, review, and test prompts to improve large language model performance.

AI Trainers Network is a global AI contributor network that shapes smarter and more human-centered AI through language and cultural expertise. It connects a diverse international community of independent contributors working on flexible, remote AI training projects.

Canada

  • Listen carefully to recorded conversations between a person and an AI voice agent.
  • Rate each agent turn on two 1–5 scales: Content (helpfulness/relevance) and Prosody (naturalness/expressiveness).
  • Write short, specific justifications for each score given.

Welo Data provides AI services, specializing in evaluating and improving AI voice agents through detailed audio rating. As a growing community of freelancers, they emphasize attention to detail and clear communication for project-based work.

India

  • Annotate text, image, audio, and video data to train large language models and AI systems.
  • Evaluate search results, ads, and chatbot outputs for factual accuracy, linguistic quality, and safety.
  • Provide detailed feedback and documentation to refine AI model reasoning and evaluation frameworks.

Our partner is a company focused on AI training and data annotation, working with a global network of linguists and tech enthusiasts. It values flexibility, transparency, and cultural accuracy in AI development.

$20–$35/hr
US

  • Label construction drawings with bounding boxes, polygons, and segmentation masks to meet our accuracy bar.
  • Apply guidelines consistently, flag ambiguous cases, and clean existing datasets.
  • Hit weekly quality and throughput targets while working closely with ML engineers.

Bobyard uses computer vision and NLP to automate construction takeoffs and estimates, so contractors bid faster and win more. We raised a $35M Series A led by 8VC and are growing fast, with a fast-paced, autonomous culture.

Global

  • Transcribe Vietnamese audio recordings into accurate written text for AI speech recognition.
  • Capture speech details such as filler words, repetitions, and non-speech events with timestamps.
  • Identify speakers and apply transcription guidelines to ensure high-quality data.

CrowdGen by Appen is an AI data solutions platform that connects independent contractors with projects to improve AI models through human input. It supports a global community of contributors with flexible, project-based work.