Evaluate AI-generated responses for relevance, accuracy, and personalization using personalized prompts and data from connected Google applications.
Identify subtle issues such as incorrect assumptions, irrelevant recommendations, inconsistencies, and inappropriate personalization.
Provide clear, detailed, and structured feedback to support improvements to AI models and personalization systems.
Our partner company is seeking an AI Response Quality Evaluator to improve AI-generated responses. This is a project-based contract role with a remote, independent working environment and a duration of up to 16 weeks.
Assess the clarity, coherence, and accuracy of written content to ensure it meets project standards.
Conduct detailed writing evaluations and provide constructive feedback for continual improvement.
Identify and annotate AI-generated content, focusing on detecting low-quality or artificial text elements.
Our client is a rapidly growing, venture-backed AI company building intelligent systems with human expertise and machine learning workflows. Backed by more than $40 million in funding, the company connects a global network of experts to high-impact AI projects.
Evaluate AI model performance through real-time, voice-based conversations by roleplaying assigned scenarios with two different models.
Compare model responses across five defined dimensions, identify error clusters, and select the stronger performer with a detailed rationale.
Maintain consistent conversational turns and voice recording to ensure fair, objective comparisons.
Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise. With a 36+ year legacy, they deliver high-quality data and outcomes for AI builders and adopters.
You'll review and edit copy across blog, Help Center, and product UI to ensure consistency and quality.
You'll fact-check every piece and keep facts consistent across all surfaces.
You'll shape content for AI answers and maintain a human, alive brand voice.
Higgsfield AI is a generative AI company that has achieved rapid growth with $700M in annual revenue and over 30 million users worldwide. It powers 390 Fortune 500 brands and has a strong content team that maintains the brand's voice across all platforms.
Evaluate AI-generated responses for safety and bias against strict rubrics.
Classify harmful content categories like hate speech and self-harm.
Verify factual accuracy of model claims using external sources to prevent hallucinations.
TELUS Digital is a leading AI data company that trains models to be safe and accurate. They have a global community of over one million contributors and foster a collaborative, flexible culture.
Craft creative prompts and multi-turn scenarios to stress-test AI guardrails across diverse risk categories.
Discover ways around safety filters and restrictions using jailbreak, evasion, and prompt injection techniques.
Evaluate and score model responses against structured harm taxonomies and severity rubrics.
Handshake AI partners with leading AI research labs to make models safer and more robust. Our red teaming operations help identify vulnerabilities before they reach users, contributing directly to the responsible development of frontier AI systems.
Plan and scope support content for upcoming product launches in collaboration with cross-functional teams.
Write, edit, and optimize Help Center articles, chatbot responses, and Generative AI content.
Manage pre-launch content, test features, and ensure day-one readiness across all channels.
itD is a consulting and software development company that blends diversity, innovation, and integrity with real business results. It is a woman- and minority-led firm with a global community and a focus on empowering employees.
Review datasets and task outputs to assess accuracy, completeness, and consistency.
Apply detailed evaluation rubrics and identify errors, inconsistencies, and quality issues.
Provide clear feedback and help improve data quality and AI evaluation processes.
Our partner is a company focused on data analysis and AI evaluation, supporting the development of next-generation AI systems. This remote contractor role offers an opportunity to apply your analytical expertise to emerging AI projects.
Evaluate AI-generated work products in real estate, hospitality, and events using quality rubrics.
Identify factual, aesthetic, and presentation errors and provide actionable feedback.
Apply industry expertise to distinguish realistic, commercially sound work from generic AI content.
The company develops AI systems and evaluates their outputs for quality. They seek experienced industry professionals for flexible remote contract work.
Create realistic PowerPoint tasks from real advisory work, including building decks from source documents, templates, and precise edits.
Work through each task yourself to establish a clear, correct answer.
Write yes-or-no checklists precise enough for an AI grader to mark any attempt.
Aptura is a London-based company studying how AI is changing professional work, especially in finance and advisory. It was founded by people with backgrounds at Lazard, McKinsey and Partners Group and takes a close look at where AI helps or falls short.
Evaluate conversations between users and AI voice agents for content quality and prosody.
Rate each AI agent turn on a 1–5 scale and provide written justification.
Maintain consistent, well-reasoned ratings with strong attention to detail.
Welo Data provides AI services, specializing in data annotation and evaluation for machine learning models. As a global company, they offer freelance opportunities for detail-oriented contractors to support AI development projects.
Edit and rewrite AI-generated content for client websites and third-party publications.
Verify facts, research unfamiliar topics, and flag unsupported claims or weak sourcing.
Optimize content for search intent, SEO, GEO, and readability across brands and industries.
Interdependence is rebuilding the PR industry with a proprietary platform that analyzes 300,000+ stories daily across a network of 250,000 journalists. The 100+ person team, named one of America's Best PR Agencies, works with brands and leaders across consumer, healthcare, tech, B2B, travel and entertainment.
Evaluate and label AI model outputs to improve performance and alignment with project guidelines.
Create prompts, rewrite text, and generate training data for large language models.
Work on flexible, remote, project-based tasks while helping shape the future of AI.
Innodata is a global data engineering company that enables the responsible advancement of AI by providing data, evaluation frameworks, and human expertise. With a 36+ year legacy, the company delivers high-quality data and outstanding outcomes for customers.
Test and document effective AI prompts to build a shared prompt library for the marketing team.
Repurpose existing content assets like webinars into blog drafts, social posts, and FAQs.
Research best practices for content visibility in AI-powered search engines and assistants.
Carlisle Companies is a leading manufacturer of building envelope products and solutions that make buildings more energy efficient, durable, and sustainable. With manufacturing, engineering, R&D, and corporate functions across North America and globally, Carlisle prioritizes safety, inclusion, career growth, and excellent benefits.
Edit and enhance AI-generated content for client websites, blogs, and marketing campaigns.
Research and fact-check claims to ensure accurate, credible, publication-ready material.
Optimize content for SEO, GEO, and AI-driven search while collaborating with teams.
Jobgether is an AI-powered platform that connects candidates with hiring companies. This position is with a partner communications and marketing firm, known for a collaborative, entrepreneurial culture and career development opportunities.
Review AI-generated business emails, reports, and strategies to ensure they are professionally sound.
Fact-check AI suggestions for marketing plans, budgets, and adherence to standard business rules.
Teach AI common office tasks such as meeting summaries, invoice drafting, and project timeline creation.
TELUS Digital operates a global AI community of over one million contributors who help collect, enhance, and train content for AI models. The community is diverse, flexible, and focused on shaping innovative AI technologies used by world-class brands.
Own the build out of new agents, skills, and platform capability for teams across TLDR.
Build and deploy agents end to end, from design through implementation, evals, and rollout to internal users.
Partner with stakeholders across sales, editorial, and people ops to find where an LLM belongs in their process.
TLDR runs the largest network of tech newsletters in the world, with over 8 million subscribers covering startups, software engineering, AI, and more. Our 31-person full-time team is bootstrapped, profitable, and on track for $35M in revenue this year, with a culture of owning functions rather than slices.
Create realistic PowerPoint tasks from source documents, templates, and financial advisory scenarios.
Complete each task to establish accurate expected outputs and develop objective yes/no evaluation criteria.
Apply professional presentation standards to support the evaluation of AI-generated presentations.
The hiring partner is an organization that evaluates AI capabilities in professional presentation workflows, focusing on banking and advisory content. The company supports a fully remote, independent work culture and uses AI-assisted processes for candidate matching.
Label, annotate, and evaluate German-language content including photos, graphics, and videos for linguistic and cultural accuracy.
Evaluate AI-generated content against Canva's quality bar for German users to shape language experiences.
Build and contribute to German-specific datasets to support the internationalization of Canva AI features.
Canva is a design platform redefining how the world experiences design. It is a global company with a large user base, known for its innovative culture and focus on AI-powered features.