Source Job

• Evaluate LLM-generated transcriptions on their ability to effectively understand conversations from an audio recording.
• Generate high-quality human annotations to correct model-generated transcripts.
• Apply consistent annotations by following clear taxonomies and detailed evaluation guidelines.

Neon partners with leading AI teams to improve the quality, usefulness, and reliability of audio-based AI systems. Projects focus on evaluating and improving transcriptions of audio recordings generated by large language models (LLMs).

• Listen to short audio clips in Russian and evaluate them using a defined rubric.
• Accurately identify target accents from provided audio samples.
• Compare multiple recordings and assess which one sounds more natural in relation to the target accent.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.

• Creation and editing of English subtitles.
• Subtitle localization using AI tools.
• Management of freelance proofreaders (communication, deadlines).

HOLYWATER is a tech company creating entertainment products at the intersection of human creativity and artificial intelligence. They build AI-native platforms redefining storytelling and empowering anyone to become a creator, and have over 60 million app downloads.

• Record short audio clips in both of your native languages following project guidelines.
• Ensure recordings meet quality, clarity, and accuracy standards.
• Collaborate with our global community to deliver consistent, high-quality data.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.

• Create music that matches provided examples and musical guidelines
• Compose and arrange original music pieces
• Follow instructions and training materials provided in English

The company is helping to teach AI to create music styles. The role is a project-based opportunity as an Independent Contractor.

• Listen to short audio clips in Chinese (Mandarin, Putonghua) and evaluate them using a defined rubric.
• Accurately identify target accents from provided audio samples.
• Apply consistent and objective judgment based on provided evaluation guidelines.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They are building smarter, more human AI with a diverse community in 100+ countries.

• Evaluate AI model outputs related to your field.
• Assess content and provide feedback to strengthen the model’s understanding.
• Develop prompts for AI models reflecting your field and evaluate responses.

Handshake is recruiting Medical Secretaries and Administrative Assistant Professionals to contribute to an hourly, temporary AI research project. The Handshake AI opportunity runs year-round, with project opportunities opening periodically across different areas of expertise.

• Provide translations and localisation support for product and content teams.
• Translate documentation, help articles, marketing campaigns, and company presentations.
• Create and update style guides, glossaries, and maintain the translation memory.

DICE is redefining live entertainment. They are based throughout Europe, North America, Australia and India, and is rapidly growing worldwide.

• Record remote hearings.
• Verify spellings of participants, unusual terms, and places.
• Complete all digital paperwork and upload all audio promptly.

eScribers is a leader in reporting and transcription services for courts and government agencies across the US, UK & Ireland. It is a private equity backed company that is growing rapidly worldwide, leading the court reporting market in technology innovations and client services.

• Evaluate AI-generated responses for accuracy, grammar, and cultural relevance.
• Identify issues and provide refined, high-quality rewritten responses.
• Create natural prompts and responses in Spanish to improve conversational datasets.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They're building smarter, more human AI with a diverse community in 100+ countries.

• Native or near-native fluency in Central Khmer.
• Based in: Cambodia, Thailand.
• Comfortable with digital tools.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They’re building smarter, more human AI with a diverse community in 100+ countries.

• Show up on time to all assignments.
• Completely understand each and every task given before beginning task.
• Answer all questions fully and honestly.

The company conducts research studies, either at home over the internet or locally in person. They rely on employee/contractor participation and feedback to make critical business decisions in areas including marketing and product development.

• Check factual assertions in podcast and video episodes to determine veracity and correctness on deadline.
• Conduct quick and accurate research to gather and verify facts in collaboration with producers, editors and hosts.
• Work to ensure fairness and accuracy; correct contradictions and omissions in consultation with producers, editors and hosts; correct spelling and grammar.

The New York Times seeks the truth and helps people understand the world through independent journalism. It is a world-renowned newsroom with journalists reporting on the ground from nearly 160 countries, focused on delivering quality journalism across various platforms.

• Perform quality control on scripts, dubbed audio tracks, mixed audio tracks, and subtitles.
• Create localized metadata for regional audiences.
• Meet tight deadlines while managing multiple projects and delivering QC feedback.

Beast Industries is a multifaceted media and entertainment company founded by Jimmy Donaldson, popularly known as MrBeast. They are known for revolutionizing digital content creation, encompassing ventures like digital media, philanthropy, consumer products, and innovative business initiatives.

• Completing AI training tasks such as analyzing, editing, and writing in Mandarin
• Judging the performance of AI in performing Mandarin prompts
• Improving cutting-edge AI models

Prolific is building the biggest pool of quality human data in the world and is not just another player in the AI space. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

• Review short, pre-segmented datasets.
• Evaluate model-generated replies based on Tone or Fluency .
• Read a user prompt and two model replies, then rate each using a five-point scale.

CrowdGen, by Appen, focuses on AI response evaluation. They are looking for native Javanese speakers to contribute to a multilingual AI response evaluation project where you review large language model outputs.