Source Job

Europe

  • Own and extend our offline eval suite across AI products, building datasets, judges, and metrics for quality assurance.
  • Build and maintain online quality dashboards tracking resolution rate, CSAT, and LLM-as-judge signals.
  • Close the production feedback loop by mining failure patterns from real traffic and translating data into product decisions.

Python SQL Statistics Analytical Machine Learning

20 jobs similar to Product Data Scientist — AI Evaluation & Quality

Jobs ranked by similarity.

Europe

  • Set the vision and roadmap for AI-native product experiences across the platform.
  • Work alongside AI engineers as a technical peer to make real trade-off calls and prototype relentlessly.
  • Balance experimentation speed with the rigor fintech demands, grounded in defensible commercial metrics.

Finom is a European tech startup building an all-in-one financial B2B platform for entrepreneurs. With over $346 million in total funding and a growing presence across EU markets, they maintain a startup culture that values thorough research, swift implementation, and employee impact.

Global

  • Own product analytics end-to-end, from event instrumentation to dashboards and experimentation.
  • Analyze user behavior across funnels, cohorts, and segments to identify improvement opportunities.
  • Partner with Product, Engineering, and Design to translate data insights into concrete product changes.

Nous Research builds AI agent products, including Hermes Agent, to help users interact with intelligent systems. The company operates in a fast-moving environment with an entrepreneurial mindset, emphasizing AI-assisted development and cross-functional collaboration.

US

  • Evaluate AI quality across the advisor stack, including pre-call briefs, in-call guidance, and post-call outputs.
  • Iterate inside ORA by refining prompts, updating knowledge base entries, and tweaking skills to close the loop on issues.
  • Surface trends and drive continuous improvement by tagging conversations, logging issues, and recommending prioritized improvements.

HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership.

$239,600–$359,400/yr
US

  • Turn complex product, customer, and risk data into clear insights and decision frameworks.
  • Use AI tools and agent workflows to improve speed and quality of analytical work.
  • Define and maintain measurement frameworks for credit products including customer eligibility and repayment behavior.

Block builds technology to increase access to the global economy through brands like Square, Cash App, and Afterpay. Cash App has thousands of employees globally, with a culture geared toward innovation, collaboration, and impact.

Global

  • Research data collection strategies and design high-impact data slices that uncover model failure modes.
  • Model annotator behavior and design experiments to optimize instruction clarity and reward signal reliability.
  • Develop metrics and frameworks for evaluating dataset quality, diversity, and impact on downstream model alignment.

Surge AI builds a platform that powers the most powerful AI models in partnership with companies like Anthropic, Google, Microsoft, and Meta. They are a profitable, bootstrapped company focused on human intelligence and data quality.

$97,419–$114,610/yr
Canada

  • Own the roadmap for data-powered product features including benchmarks, longitudinal insights, cross-survey intelligence, and more.
  • Identify where our data corpus creates customer value worth paying for and where it doesn’t.
  • Build the measurement framework to understand what drives retention and expansion.

We are the world’s most popular platform for surveys and forms, built for business—loved by users. We have been trusted by millions for over 25 years and foster a culture of curiosity and inclusion, with a global team and offices in multiple countries.

Global

  • Own an AI-native product end-to-end, from customer discovery to shipping weekly iterations.
  • Drive growth, activation, conversion, and monetization metrics while building alongside your team.
  • Prototype with AI tools and fix your own interface instead of filing tickets.

airSlate is a global SaaS technology company that develops no-code workflow automation, electronic signature, and document management solutions. With hundreds of millions of users and over one million customers worldwide, the company has teammates in more than 20 countries across three continents and fosters a culture of growth and innovation.

$81,000–$105,600/yr
US

  • Translate product requirements into ML-actionable specs, defining training objectives, acceptance criteria, and edge cases.
  • Own the data acquisition and labeling roadmap, writing guidelines and quality standards for the ML team.
  • Evaluate model outputs and training runs, making go/no-go recommendations and coordinating assessment resources.

CubiCasa is the global leader in residential indoor floor plan technology, enabling professional floor plans via a simple 5-minute scan. They have scaled to 1.2 million+ floor plans and 35,000+ partners, with a culture emphasizing collaboration, simplicity, growth, and customer focus.

$95,000–$133,000/yr
Canada US

  • Own discrete analytics projects from start to finish with senior analyst guidance.
  • Build and maintain dashboards for Product and Technology teams to track progress.
  • Work with clickstream and behavioral data (Amplitude) to understand user product journeys.

1Password builds enterprise password management and Unified Access Management cybersecurity solutions. With over 180,000 business customers and a spot on the Forbes Cloud 100, they foster a human-centric, collaborative, and fast-paced remote-first culture.

$258,000–$348,000/yr
United States Unlimited PTO

  • Own AI evaluation methods and operations for Figma's AI-powered experiences, defining quality dimensions and designing measurement frameworks.
  • Build and maintain evaluation frameworks, rubrics, golden datasets, and quality bars using human and automated approaches.
  • Produce clear readouts and dashboards to enable stakeholders to make confident shipping decisions.

Figma is on a mission to make design accessible to all, empowering teams to bring ideas to life through collaborative design and prototyping tools. With a growing team of passionate creatives and builders, Figma fosters a culture of growth and inclusivity.

$140,000–$150,000/yr
US Unlimited PTO

  • Own AI product strategy for investor workflows, building AI-native products that transform how public market investors consume and act on data.
  • Work directly with customers like hedge funds and asset managers to deeply understand workflows and pain points.
  • Collaborate across engineering, data, research, and design to ship high-quality, high-impact products.

YipitData is a leading market research and analytics firm for the disruptive economy. They operate globally with offices in the US, APAC, and India and have an award-winning, people-centric culture recognized by Inc. as a Best Workplace for three consecutive years.

Sweden

  • Review completed tasks from trainers, including questions, images, and golden answers, to ensure accuracy and consistency.
  • Independently verify golden answers based on images and flag errors, inconsistencies, or ambiguities.
  • Provide clear feedback and track error patterns to maintain high data quality and escalate unclear cases.

Welo Data, part of Welocalize, is a global AI data company with over 500,000 contributors delivering high-quality, ethical data to train advanced AI systems. They operate in 100+ countries, offering flexible remote work and growth opportunities.

$125,000–$160,000/yr
US Canada

  • Own the Customer Workflows domain, including employer/recruiter portals and agentic AI features, driving end-to-end product strategy and roadmap.
  • Operate as a builder, leveraging AI-native tools to rapidly prototype and shrink the time from customer problem to working solution.
  • Lead cross-functional initiatives with engineering, data, and customer success teams to define OKRs and evaluation frameworks.

FutureFit AI is an AI-powered workforce development platform that helps people get better jobs faster, focusing on those facing barriers to opportunity. The company has a team of 30-50 across the US and Canada, fostering a culture of high velocity, high trust, and audacious goals.

$43,200–$54,000/yr
Global

  • Own the metrics and analytical direction for your product area, influencing strategy and roadmap priorities through data insights.
  • Work with cross-functional teams to define success metrics, build frameworks, and validate hypotheses through experimentation and A/B testing.
  • Perform data manipulation, root-cause analysis, and segmentation to understand customer drivers and optimize product features.

Docplanner is a healthcare technology company that empowers patients with access to reviews and booking, and provides doctors with tools to manage appointments. With over 2,500 employees worldwide, they maintain a startup mindset and a diverse, inclusive culture.

Global

  • Support the design and creation of the global Customer Success function, focusing on insights, productivity, and best practices.
  • Independently lead data analytics and modeling with a focus on retention and growth, using tools like SQL, Superset, and Python.
  • Act as a Technical Project Manager for strategic initiatives, coordinating stakeholders and scaling results across markets.

Docplanner Group is on a mission to help people live longer, healthier lives as the world's largest healthcare platform, connecting 24 million patients with 280k doctors across 13 countries. With over 3,000 employees, they operate in a fast, flexible, and hands-on culture that values real impact and long-term growth.

Europe

  • Turn customer insights and performance data into creative hypotheses using AI.
  • Work with Design, UA, Growth, and Product teams to launch and scale new concepts.
  • Evaluate ad performance beyond CTR and generate actionable insights to optimize results.

Liven builds an AI-powered self-discovery app that helps people understand their emotions and build healthier relationships. With over 5 million downloads, they foster a culture of curiosity, experimentation, and a 'Day 1' spirit.

$155,520–$219,040/yr
Europe UK

  • Build and maintain data pipelines, warehouses, and the underlying infrastructure.
  • Develop AI agents and internal workflows on top of the data foundation to drive efficiency.
  • Enable the product and broader organization to make faster, data-driven decisions.

Duvo Inc. is a company that leverages data to create AI-native workflows and agents, enabling faster, data-driven decisions across the organization. They are a team focused on innovation and building efficient data foundations.

US Canada

  • Own the roadmap and execution for customer workflow products, driving AI-native development and cross-functional collaboration.
  • Define product requirements and success metrics while conducting continuous customer research to validate decisions.
  • Partner with engineering and analytics teams on technical decisions, scalability, and integration strategies.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective skill-based reviews. It is a growing technology company focused on transforming employment access, with a culture emphasizing curiosity, ownership, and collaboration.

$165,000–$225,000/yr
US Canada Unlimited PTO 18w maternity 12w paternity

  • Lead the roadmap and delivery across Webflow's AI agent surfaces, including the AI Assistant, MCP, Agent Instructions, and the underlying AI platform.
  • Define what quality means for non-deterministic AI products, setting evals, guardrails, and metrics to ensure high standards.
  • Balance developer-grade tools with approachable experiences for less-technical creators, contributing to product strategy and shipping features.

Webflow is the agentic web marketing platform for modern marketing teams, helping organizations build, manage, and optimize high-performing web experiences that drive predictable growth and strengthen brand trust. The company is a fast-moving, craft-focused organization that values quality and grit.

Europe Unlimited PTO

  • Partner with product and business teams to drive rigorous analysis, from root cause to funnel drop-off, and turn data into prioritized recommendations.
  • Define and maintain metric definitions, set up tracking, and build automated reporting with alerting for KPI changes.
  • Design and interpret experiments, model data in dbt and BigQuery, and create AI-assisted analytics skills to scale impact.

We are building the operating system for value movement, enabling crypto, stablecoins, and tokenized assets. With 30M+ customers and 500+ ecosystem partners, we maintain a high-standards, high-velocity culture and are regulated across multiple regions.