Source Job

• You will be matched with another participant for 1-on-1 verbal or text-based exchanges.
• Use your natural Dutch from Netherlands dialect to discuss various topics provided by the researcher.
• Help the AI understand the nuances, slang, and cultural context of Dutch from the Netherlands, through real-world interaction.

Prolific is building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

• Make scripted and unscripted voice calls with an AI agent.
• Produce clear, natural Haitian Creole speech while following the provided guidelines.
• Evaluate how well the AI agent understands spoken language, helping test speech recognition and transcription accuracy.

RWS is a company that embraces DEI and promotes equal opportunity. They are committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment.

• Review and label content for sentiment, factual accuracy, and reasoning issues.
• Evaluate model outputs across quality dimensions using scoring frameworks.
• Validate automated assessments and identify discrepancies or errors.

Welo Data provides AI services helping to develop and evaluate large language models (LLMs). The job posting does not provide information regarding the company's size and culture.

• Evaluate AI-generated responses for accuracy, grammar, and cultural relevance.
• Identify issues and provide refined, high-quality rewritten responses.
• Create natural prompts and responses in English to improve conversational datasets.

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. They build smarter, more human AI with a diverse community in 100+ countries.

• Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions.
• Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
• Evaluate model performance across a standardized set of qualitative and quantitative metrics.

They are dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.

• Create and answer questions to train AI models.
• Review, analyze, and rank AI-models' chains of thought for correctness and approach.
• Provide clear, constructive feedback to improve AI-generated responses.

An Enterprise client is seeking talents who are fluent in English who will help train generative artificial intelligence models. They seem to maintain a contractor-based work environment.

• You'll work with AI tools, test model outputs, and evaluate responses.
• Document errors, gaps, and collaborate with our team.
• Spot inconsistencies and provide structured feedback.

Project World Wide is involved in shaping the future of AI through training data. They seek motivated individuals to contribute to the development of cutting-edge AI systems.

• Scope and implement AI Agent deployments, providing strategic advice and execution support to customers and partners.
• Leverage knowledge of LLM internals to analyze customer requirements and design precise prompts for reliable, user-aligned behavior.
• Fine-tune conversational flows and voice output to align with customer brand standards.

Parloa is a fast-growing startup in the world of Generative AI and customer service. They have over 400 employees in Berlin, Munich, and New York and are expanding globally.

• Evaluate AI-generated content related to audio tasks.
• Provide feedback to help AI better understand audio tasks.
• Review AI-generated responses for accuracy.

Handshake is connecting students, recent graduates, and employers. They aim to democratize opportunity and are building a diverse community.