Source Job

US

  • Review and annotate AI agent conversations across clinical use cases to assess accuracy, safety, and guideline adherence.
  • Score and annotate agent performance using structured rubrics and evidence-based protocols.
  • Identify clinical safety concerns and provide actionable feedback to refine AI-driven clinical agents.

RN License Clinical Experience Clinical Judgment Written Communication Data Annotation

20 jobs similar to RN Clinical Data Annotation Specialist

Jobs ranked by similarity.

Global

  • Review transcripts of short AI conversations focused on mental health topics.
  • Evaluate the safety, tone, and clinical appropriateness of generated responses.
  • Write clinically sound example responses and develop structured grading rubrics.

Terac is building the world's largest pool of vetted human experts for AI, helping researchers and labs recruit, screen, and pay study participants across industries. Their platform connects specialized professionals with paid AI research opportunities.

US

  • Perform concurrent medical record reviews on nursing units to clarify patient documentation.
  • Prompt physicians to resolve missing, unclear, or conflicting documentation for appropriate reimbursement.
  • Provide education to patient care providers on clinical documentation standards and coding requirements.

Virginia Mason Franciscan Health provides a full spectrum of health care services across the Puget Sound region, with a legacy of compassionate care and innovation. With 10 hospitals and nearly 300 care sites, the organization is dedicated to healing the whole person through rigorous research, education, and collaboration.

Global

  • Audit AI 'Chain-of-Thought' reasoning for medical diagnostics to ensure adherence to international clinical protocols.
  • Rigorously verify AI-generated drug interactions, dosage recommendations, and contraindications against peer-reviewed medical literature.
  • Precisely label complex biomedical datasets—including MRI/CT scans, pathology reports, and genomic data—to improve model visual-spatial reasoning.

TELUS Digital is a technology company that helps businesses collect, enhance, train, translate, and localize content to build better AI models. They have a global AI community of over one million contributors from diverse backgrounds, fostering a culture of flexibility and innovation.

US

  • Analyze and summarize medical records, highlighting relevant clinical findings for attorneys.
  • Prepare medical chronologies and long-term care assessments to support case evaluations.
  • Provide objective, evidence-based medical insights and coordinate with expert witnesses.

The partner company provides specialized legal nurse consulting services to attorneys, analyzing medical records and supporting injury-related cases. This role offers flexible, part-time contract work in a fully remote environment.

US

  • Guide patients through complex health concerns and help them achieve wellness goals while addressing social determinants of health.
  • Build trusting relationships through empathetic listening and create comprehensive care plans for consistent action.
  • Work 100% remotely as a 1099 contractor, setting your own hours and interacting with patients via video or phone.

Solace pairs patients with expert healthcare advocates to navigate the complex U.S. healthcare system and improve health outcomes. A lean, mission-driven Series C startup founded in 2022, its U.S.-based team is intense, urgent, and passionate about redefining healthcare.

US

  • Prepare comprehensive AWV charts and conduct face-to-face virtual visits via Zoom.
  • Review patient histories, medications, screenings, and assessments to identify care gaps.
  • Maintain accurate documentation and ensure compliance with Medicare, CMS, and HIPAA standards.

CareTalk Health is a fully remote, nationwide virtual medical practice that partners with Medicare Advantage plans to deliver Annual Wellness Visits and close care gaps. It is a fast-growing telehealth organization with a nationwide clinical team focused on making virtual care simple, reliable, and human.

US

  • Review psychiatric clinical documentation against Headway's quality standards to ensure safe, evidence-based care.
  • Provide coaching and remediation to providers on documentation and clinical decision-making.
  • Work with AI-assisted review tools to evaluate outputs and improve quality rubrics.

Headway builds software that helps mental health providers manage their practices and accept insurance, making therapy more accessible. They are a Series D company with $325M+ in funding, supporting over 75,000 providers across all 50 states.

US

  • Manage and triage patient vital signs remotely, using motivational interviewing to drive positive health behavior changes.
  • Perform monthly wellness calls with patients, collaborating with care teams to set patient-centric goals.
  • Escalate urgent care needs appropriately and meet program engagement metrics in a remote MST-based role.

Vivo Care is building a future where care is continuous, personal, and connected, challenging the status quo in healthcare. We are a fast-growing startup where everyone has a voice, fostering a culture of inclusion, collaboration, and innovation.

US

  • Performs pre-admission, admission, and continued stay reviews using approved medical necessity criteria.
  • Coordinates patient care and communicates with physicians, patients, caregivers, and third-party payers.
  • Manages patient progression through the healthcare system and proactively works with payers to secure certification and minimize denials.

Ochsner Health is a leading not-for-profit healthcare provider in the Gulf South, with 46 hospitals and 370+ care centers. It employs more than 38,000 team members and has been recognized as a top workplace and the No. 1 hospital in Louisiana.

$19–$23/hr
Canada

  • Provide clinical and administrative support to a remote healthcare team during weekends, holidays, and peak patient volume.
  • Review laboratory results, coordinate referrals and pharmacy communications, and document actions in the EMR.
  • Work independently while collaborating with physicians, PAs, and care coordinators to ensure continuity of care.

The partner company is a growing virtual care organization delivering remote healthcare services across Canada. Their team focuses on inclusive, accessible patient care and multidisciplinary collaboration.

United States

  • Evaluate AI model responses across diverse topics and use cases against established quality standards.
  • Write, test, and refine system prompts to influence model behavior and performance.
  • Identify and document model failures and provide clear, actionable feedback to product teams.

This company specializes in evaluating and improving advanced AI systems through content evaluation and prompt engineering. It operates as a partner company managing applications for this role, focusing on quality and consistency in AI behavior.

$75,265–$109,761/yr
US Unlimited PTO

  • Perform quality audits on clinical documentation across clinical departments.
  • Collaborate with leadership to develop corrective action plans and provide 1:1 coaching.
  • Support organizational readiness for NCQA and other regulatory audits.

Oscar is the first health insurance company built around a full stack technology platform, focusing on serving members with a concierge-level experience. It started in 2012 and is an Equal Opportunity Employer cultivating an authentic, inclusive environment.

$35–$35/hr
US Unlimited PTO

  • Manage communications between patients and doctors, including documentation, referrals, and labs.
  • Collaborate with clinical, operations, and customer service teams to resolve patient concerns quickly.
  • Provide clinical feedback on medications, labs, and side effects while supporting physicians.

Hone is an online medical clinic focused on transforming healthcare and enhancing longevity through virtual care. It is a remote-first, fast-paced company that values candid communication, collaboration, and calculated risk-taking.

$78,000–$99,200/yr
US

  • Conduct clinical and billing reviews of claims, itemized bills, and UB-04 forms to ensure accuracy.
  • Perform utilization reviews to assess medical necessity and validate charges against policies.
  • Mentor reviewers, meet productivity targets, and maintain active RN licensure with CEUs.

Our partner is a healthcare services company that conducts medical claims and utilization reviews to ensure accurate billing and appropriate care. They offer a collaborative, quality-focused remote environment with opportunities for professional development.

Global

  • Review text or media samples based on provided project guidelines
  • Apply accurate labels and categorizations to diverse data sets
  • Evaluate AI-generated responses for clarity, safety, and factual accuracy

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

$120,000–$140,000/yr
US

  • Lead complex client implementations, from customer use cases to success metrics and clinical workflows.
  • Train and educate customers on BioIntelliSense product offerings and value proposition.
  • Provide ongoing clinical support and post-implementation optimization while coordinating across teams.

BioIntelliSense is a healthcare technology company providing FDA-cleared wearable monitors, like the BioButton, and AI-driven analytics for early detection of patient decline. The company has a remote-first culture with a global team and offices in Colorado and California.

New Zealand

  • Provide timely, high quality clinical recommendations grounded in evidence-based practice.
  • Communicate assessment findings and provide advice to the in-centre team.
  • Coach targeted care team members and use technology including Microsoft Teams and electronic resident management systems.

Summerset develops and operates retirement villages across New Zealand, providing care and services that bring the best of life to residents. Their culture is built on teamwork, care, and a drive for excellence, with a strong sense of values.

US

  • Review datasets and task outputs to assess accuracy, completeness, and consistency.
  • Apply detailed evaluation rubrics and identify errors, inconsistencies, and quality issues.
  • Provide clear feedback and help improve data quality and AI evaluation processes.

Our partner is a company focused on data analysis and AI evaluation, supporting the development of next-generation AI systems. This remote contractor role offers an opportunity to apply your analytical expertise to emerging AI projects.

US

  • Evaluate AI model performance through real-time, voice-based conversations by roleplaying assigned scenarios with two different models.
  • Compare model responses across five defined dimensions, identify error clusters, and select the stronger performer with a detailed rationale.
  • Maintain consistent conversational turns and voice recording to ensure fair, objective comparisons.

Innodata is a global data engineering company that enables responsible AI advancement by providing data, evaluation frameworks, and human expertise. With a 36+ year legacy, they deliver high-quality data and outcomes for AI builders and adopters.

US

  • Own quality performance across all clinical tiers, including call and documentation quality for RNs, providers, and PSS Engagers, plus organization-wide clinical outcomes.
  • Lead and develop a team of Quality Reviewers, setting standards, conducting calibrations, and coaching to ensure consistent, defensible scoring.
  • Build and analyze quality dashboards and datasets to identify trends, root causes, and improvement opportunities, presenting findings to executive leadership.

CareTalk Health is a fully remote, nationwide virtual medical practice partnering with Medicare Advantage plans to deliver Annual Wellness Visits and close care gaps. We are a growing, collaborative team focused on making virtual care simple, reliable, and human.