Source Job

United States

  • Design and own the quality of clinical datasets for training and evaluating health AI models.
  • Collaborate with cross-functional teams to translate customer goals into dataset specifications and evaluation plans.
  • Ensure clinical realism, statistical defensibility, and compliance in health AI evaluation workflows.

Python SQL Statistical Analysis LLM Evaluation

12 jobs similar to Applied Data Scientist, Health AI Evaluation & Datasets

Jobs ranked by similarity.

United States

  • Design and own the datasets and evaluation specifications for financial-domain LLMs, vision-language models, and AI agents, focusing on unstructured and multimodal financial data.
  • Translate customer goals into concrete dataset specifications, taxonomies, rubrics, and acceptance criteria, ensuring domain validity and statistical defensibility.
  • Develop evaluation methodology beyond surface accuracy, covering numerical consistency, hallucination rates, refusal appropriateness, and fairness across customer segments.

Innodata is a global data engineering company that enables the responsible advancement of artificial intelligence by providing data, evaluation frameworks, and human expertise. With over 36 years of experience, the company delivers high-quality data and solutions for Generative AI builders and adopters.

$129,700–$162,100/yr
US

  • Deliver production-grade AI products using LLMs, NLP, and ML to process unstructured clinical data and drive early disease identification.
  • Collaborate with Market Operations, Insights Engineering, and Clinical teams to create real-world impact.
  • Communicate the value and opportunities of AI to internal stakeholders in a fast-paced agile environment.

Agilon health is a healthcare company focused on transforming care delivery for seniors through value-based models. With a collaborative culture and a team dedicated to innovation, they aim to improve outcomes for patients and physicians alike.

UK

  • Execute end-to-end data science projects, from problem definition to deployment, building machine learning and NLP solutions for client decision-making.
  • Design scalable data pipelines and workflows, apply LLM APIs, and integrate cloud services into analytical deliverables.
  • Partner with senior data scientists, engineers, and client teams to create reusable tools that scale insights across projects.

Inizio Medical is part of Inizio, a global leader in healthcare communications. They help pharmaceutical and healthcare organizations turn complex science into meaningful impact through data, insights, and innovation.

$178,800–$198,600/yr
US Unlimited PTO

  • Own the gold data layer by transforming silver tables into curated, semantically rich datasets for AI model development.
  • Reverse-engineer data semantics by collaborating with product engineers, clinical experts, and analyzing SQL queries and stored procedures.
  • Build pipelines for reuse, automate quality filtering and synthesis, and maintain reproducible dataset snapshots.

PointClickCare is a leading health tech company that helps providers deliver exceptional care through AI and data. Privately held and founder-led, they serve over 30,000 organizations, were recognized as a top private cloud company by Forbes, and have one of Canada's Most Admired Corporate Cultures.

$160,000–$229,000/yr
US 4w PTO 16w maternity 8w paternity

  • Own clinical data quality across claims, EHR, and ADT, defining standards for structuring, normalizing, and validating data as modeling inputs.
  • Build and ship production ML/AI models for risk stratification, care gap prediction, and treatment effect estimation.
  • Apply health economics and outcomes methods to translate clinical data into decision-grade evidence aligned with CMS and NCQA standards.
  • -

Waymark is a team of healthcare providers, technologists, and builders whose mission is to bring the best healthcare to people with Medicaid benefits. We bring support and technology-enabled care to help primary care providers keep Medicaid patients healthy. We are a remote team that values bold builders, humble learners, and focused urgency.

United States

  • Design and deliver high-quality AI evaluation data initiatives, from proposals through pilot execution and production readiness.
  • Recruit and manage subject-matter experts across technical domains, ensuring rigorous quality control frameworks.
  • Act as key interface with AI lab partners, converting pilots into scaled production engagements.

Jobgether uses AI-powered matching to connect candidates with roles quickly and fairly. They are a remote-first company that shares top-fitting candidates with hiring partners.

$159,100–$176,700/yr
Canada Unlimited PTO

  • Build and own the gold data layer between the silver Lakehouse data and AI model development teams.
  • Reverse-engineer data semantics by collaborating with product engineers, clinical experts, and reading SQL queries and stored procedures.
  • Curate datasets across modalities, build reusable pipelines, and automate quality, filtering, and synthesis for AI research needs.

PointClickCare is a leading health tech company that helps providers deliver exceptional care through a platform serving over 30,000 provider organizations. Founder-led and privately held, the company reinvests in R&D and has been recognized by Forbes as a top private cloud company and one of Canada's Most Admired Corporate Cultures.

US

  • Develop and implement scalable AI/ML solutions for generative AI models including large language models and multimodal architectures.
  • Design multi-year vision and shape the direction of crucial generative AI areas such as text generation, image synthesis, and personalized content.
  • Partner with product management and stakeholders to identify use cases, analyze patterns, and maintain compliance in healthcare AI.

Aledade is a healthcare technology company that builds web applications and data pipelines to support primary care. They are a large organization with a culture focused on engineering excellence, observability, and incremental delivery.

US

  • Own and improve production AI systems, designing and deploying scalable AI/ML solutions for critical business workflows.
  • Build AI-powered workflow platforms using generative AI models, agent frameworks, and orchestration systems.
  • Design evaluation and experimentation frameworks to optimize model quality and business outcomes.

Pivotal Health is a technology platform that helps healthcare providers get paid fairly by automating reimbursement workflows. The company is a collaborative, low-ego team on a mission to make healthcare reimbursement fairer for providers, with flexibility for remote and hybrid work.

Europe

  • Own and extend the offline eval suite across AI products, including datasets, judges, and metrics.
  • Build and maintain online quality dashboards tracking resolution rate, CSAT, LLM-as-judge signals, and more.
  • Close the production feedback loop by mining failure patterns and translating data into product decisions.

Finom is a European tech startup headquartered in Amsterdam, developing an all-in-one financial B2B platform integrating banking, accounting, and invoicing. With over $346 million in total funding and a team of hundreds, they foster a start-up culture focused on innovation, swift implementation, and user impact.

US

  • Perform extensive SQL-based data transformations, integrating data from multiple internal and external sources like claims, media, and CRM.
  • Apply statistical reasoning to analyze trends, identify performance drivers, and ensure analytical rigor in insights.
  • Develop data visualizations and dashboards that clearly communicate insights and support decision-making.

Underscore Marketing is a woman-owned, independent agency specializing in life sciences. Since 2002, we've helped clients gain a competitive edge through bold, data-driven promotional strategies, and our team of media, strategy, and omnichannel analytics experts thrives on collaboration, innovation, and results.

Poland Romania Bulgaria Serbia

  • Lead the design, implementation, and deployment of machine learning and deep learning algorithms.
  • Apply data mining and statistical analysis to build high-quality predictive models and understand user interactions.
  • Collaborate with product and engineering teams to deliver analytical interfaces supporting business strategy.

This company is an AI-driven startup optimizing healthcare operations through artificial intelligence, network science, and advanced optimization algorithms. It is a small organization focused on improving planning, scheduling, and efficiency for healthcare providers.