Evaluate AI-generated responses for relevance, accuracy, and personalization using personalized prompts and data from connected Google applications.
Identify subtle issues such as incorrect assumptions, irrelevant recommendations, inconsistencies, and inappropriate personalization.
Provide clear, detailed, and structured feedback to support improvements to AI models and personalization systems.
Our partner company is seeking an AI Response Quality Evaluator to improve AI-generated responses. This is a project-based contract role with a remote, independent working environment and a duration of up to 16 weeks.
Review text or media samples based on provided project guidelines
Apply accurate labels and categorizations to diverse data sets
Evaluate AI-generated responses for clarity, safety, and factual accuracy
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Investigate and resolve data quality issues through direct, hands-on analysis.
Maintain and execute data quality controls, review processes, and standard operating procedures.
Communicate analytical findings and recommendations clearly to cross-functional stakeholders.
We are a profitable, growth-stage company building industry-leading martech and data products for the PropTech space. We are a fully remote team of 100+ spread across the U.S., with a strict no a**holes policy and a focus on high performance.
Own and extend the offline evaluation suite for AI products, building datasets and metrics.
Build online quality dashboards and close the production feedback loop by mining failure patterns.
Translate numbers into clear decisions for Product and domain experts.
Finom is a European tech startup developing an all-in-one financial B2B platform integrating banking, accounting, and invoicing for entrepreneurs. With over €115 million in Series C funding and a team dedicated to innovation, they foster a start-up culture that values bold ideas and swift implementation.
Conduct structured quality audits on spatial datasets using mapping platforms and GIS-standard evaluation tools.
Evaluate and cross-reference complex geographic and business data against multiple authoritative sources.
Perform root-cause analysis and document discrepancies to refine mapping algorithms and improve geographic intelligence.
TELUS Digital helps build better AI models by leveraging a global community of over one million contributors who collect, enhance, and validate content. The company fosters a diverse, remote-first culture focused on intellectual rigor and structured data verification.
Evaluate AI-generated slides, spreadsheets, and documents for real-world usability and professional quality.
Assess outputs for accuracy, clarity, relevance, and alignment with data science standards.
Provide structured written feedback to help improve AI systems and their outputs.
A partner company is seeking a Data Science Expert to evaluate AI-generated work. The company focuses on improving AI systems and operates with a flexible, remote team.
Lead a team producing high-quality training data and evaluations for advanced AI models.
Review engineering-domain work, uphold quality standards, and drive operational improvements.
Coach and develop AI Tutors while collaborating with engineering and human data teams.
Jobgether is an AI-powered job platform that connects candidates with partner companies using objective matching. This role is with a partner company focused on AI training data, offering a collaborative, remote-first environment emphasizing autonomy and continuous learning.
Execute daily Data Quality checks across multiple VA sites using DMM/IRIS tools.
Investigate data-quality discrepancies, identify root causes, and coordinate corrective actions.
Validate migration queries, extracts, and transformed data for completeness and correctness.
VetsEZ provides data management and support services for the Department of Veterans Affairs, focusing on Electronic Health Record Modernization. The company size and culture are not specified in the posting.
Evaluate search results and AI-generated content for quality and relevance.
Conduct online research to verify information and support rating decisions.
Provide feedback and document edge cases to improve AI systems.
TELUS Digital AI is a global AI community of over 1 million contributors helping clients collect, enhance, and train data to build better AI models. They offer flexible remote work and a diverse, inclusive culture.
Own the quality analysis of annotated data across computer vision and ML programs, making judgment-heavy calls that cannot be outsourced.
Analyze annotation data to detect anomalies and distinguish between annotation error, model error, and genuine field degradation.
Build and maintain performance trackers, root cause analysis documentation, and pattern libraries that the team relies on.
Gather AI builds a vision-powered platform using autonomous drones to digitize warehouse workflows, making operations smarter and safer. The company is a small, fast-moving engineering team with a culture of deep technical accountability and cross-functional collaboration.
Quality-check ocean freight contracts and rates against source documents.
Collaborate with international vendor partners to resolve discrepancies.
Use AI tools to streamline QA workflows and improve efficiency.
The company specializes in ocean freight data quality assurance. It is a remote-first, international team with a feedback-driven culture that values ownership and continuous improvement.
Label, annotate, and evaluate German-language content including photos, graphics, and videos for linguistic and cultural accuracy.
Evaluate AI-generated content against Canva's quality bar for German users to shape language experiences.
Build and contribute to German-specific datasets to support the internationalization of Canva AI features.
Canva is a design platform redefining how the world experiences design. It is a global company with a large user base, known for its innovative culture and focus on AI-powered features.
Evaluate AI-generated documents, spreadsheets, and presentation decks for accuracy and professional quality.
Assess visual and aesthetic quality including layout, formatting, and readability.
Provide clear, structured written feedback to identify issues and improve AI outputs.
Our partner is a company focused on improving AI systems through quality evaluation. They offer a flexible, remote work environment for independent contractors.
Evaluate AI model performance through real-time, voice-based conversations by roleplaying assigned scenarios with two different models.
Compare model responses across five defined dimensions, identify error clusters, and select the stronger performer with a detailed rationale.
Maintain consistent conversational turns and voice recording to ensure fair, objective comparisons.
Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise. With a 36+ year legacy, they deliver high-quality data and outcomes for AI builders and adopters.
Meticulously review short-form video and static image ad assets for errors in copy, visual composition, graphics, and audio sync prior to client delivery.
Verify that all creative assets adhere strictly to platform specifications, client briefs, and updated brand and legal guidelines.
Evaluate AI-assisted checker outputs, flagging false positives and false negatives to provide structured feedback and training data that improves system accuracy.
They partner with leading direct-to-consumer and e-commerce brands to ensure digital ad quality. The company operates a fast-paced, international remote environment with a collaborative and inclusive culture.
Evaluate search results and AI-generated content for quality, relevance, accuracy, and usefulness.
Conduct online research to verify information and support rating decisions.
Participate in training, calibration sessions, and ongoing quality reviews.
TELUS Digital is a global AI community that helps customers collect, enhance, train, translate, and localize content to build better AI models. It consists of a vibrant network of over 1 million contributors from diverse backgrounds.