Perform manual, independent reviews of recorded clinical trial interviews and scale administrations to ensure scoring accuracy, interview quality, and protocol adherence.
Maintain clear, reproducible documentation of review findings, scoring justifications, and site intervention plans aligned with protocol expectations.
For senior roles, participate in clinical decision-making on site performance and oversee targeted interventions and rater remediation.
Review psychiatric clinical documentation against Headway's quality standards to ensure safe, evidence-based care.
Provide coaching and remediation to providers on documentation and clinical decision-making.
Work with AI-assisted review tools to evaluate outputs and improve quality rubrics.
Headway builds software that helps mental health providers manage their practices and accept insurance, making therapy more accessible. They are a Series D company with $325M+ in funding, supporting over 75,000 providers across all 50 states.
Review transcripts of short AI conversations focused on mental health topics.
Evaluate the safety, tone, and clinical appropriateness of generated responses.
Write clinically sound example responses and develop structured grading rubrics.
Terac is building the world's largest pool of vetted human experts for AI, helping researchers and labs recruit, screen, and pay study participants across industries. Their platform connects specialized professionals with paid AI research opportunities.
Perform on-site or remote pre-study, initiation, interim, and close-out monitoring visits to ensure adequate facilities and staff.
Identify investigators and verify qualifications, resources, and staff for conducting clinical studies.
Train investigational site staff and support regulatory submissions as applicable.
Ergomed is a specialist clinical research organization focused on rare disease and oncology trials. With a collaborative international team across North America, South America, Europe, Asia, and Australia, the company values teamwork, flexibility, and work-life balance.
Conduct comprehensive program evaluation for tools and trainings.
Support development and maintenance of detailed project plans, timelines, and budgets.
Spring Health is a global mental health company eliminating every barrier to mental health. They reach over 170 million people worldwide through leading employers, health plans, and partners, and are an AI-native company focused on personalized care.
Audit 30% of production output during the pilot phase to ensure rating quality and consistency.
Identify and flag miscalibration or inconsistent scoring across raters.
Provide clear, actionable feedback and corrections to raters.
Welo Data provides AI services, including data annotation and rating for machine learning projects. It is a community of freelancers working on various AI-related tasks.
Review prior authorization cases to ensure clinical and operational standards are met.
Audit AI outputs, third-party reviews, and internal decisions for accuracy and compliance.
Collaborate cross-functionally to refine workflows and improve patient access to treatment.
Generator Health operates a platform that streamlines prior authorization processes for patients and providers. They handle tens of thousands of patients weekly and emphasize collaboration and accuracy in a high-autonomy remote environment.
Audit 30% of production output during the pilot phase to ensure rating quality and consistency.
Identify and flag miscalibration or inconsistent scoring across raters.
Provide clear, actionable feedback and corrections to raters.
Welo Data provides AI services and general application support. They are a freelance-oriented company focused on data quality and AI training projects.
Interpret clinical trial budgets and payment terms, accurately configuring them in the CTMS/CRIO system.
Serve as a key connection point between Budget & Contract, Clinical Applications, and Accounts Receivable teams.
Support timely revenue recognition, sponsor invoicing, and accounts receivable collection through accurate system configuration.
Headlands Research is a leading network of advanced clinical trial sites, leveraging technology and support services to broaden outreach and participation. Founded in 2018, the company operates 20+ sites across the US and Canada with plans for further expansion.
Audit 30% of production output during the initial pilot phase to ensure rating quality and consistency.
Identify and flag miscalibration or inconsistent scoring across raters, providing clear feedback.
Complete onboarding and training ahead of the production pool's rollout while working independently.
Welo Data is an AI services company that provides data annotation and quality assurance for AI projects. They are a growing community of freelancers and contractors, fostering a remote work culture with a focus on accuracy and consistency.
Audit 30% of production output to ensure rating quality and consistency during the initial phase.
Identify miscalibration or inconsistent scoring across raters and flag issues early.
Provide clear, actionable feedback and corrections to raters to maintain alignment.
Welo Data provides AI services and data solutions for machine learning and artificial intelligence projects. They are a growing community of freelancers and contractors working on various AI-related tasks.
Conduct and report all types of onsite monitoring visits, perform CRF review, source document verification, and query resolution.
Be responsible for site communication and management, supervise study activities, timelines, and schedules on the country level.
Support regulatory team in preparing documents for study submissions and participate in feasibility research.
PSI is a leading Contract Research Organization with over 30 years of experience, offering a balance of stability and innovation. The company focuses on delivering quality and on-time services across a variety of therapeutic indications.
Manage Investigator sites and conduct on-site and centralized monitoring visits to ensure subject safety and data integrity.
Collaborate with cross-functional teams and external partners to maintain quality study oversight from start-up through close-out.
Support development of study documents, maintain TMF, and ensure inspection readiness while embodying core company values.
MapLight Therapeutics is a clinical stage biotech company that focuses on drug discovery for central nervous system disorders. The company combines cutting-edge technologies like optogenetics and spatial transcriptomics to identify novel drug targets, with a culture of integrity, collaboration, bravery, and dedication.
Evaluate conversations between users and AI voice agents by listening to recorded interactions.
Rate each AI agent turn on two 1-5 scales: content quality and prosody naturalness.
Provide clear, specific written justifications for each rating given.
Welo Data provides AI services, specializing in data evaluation and human feedback for AI systems. They are an established company with a global community of freelancers and a focus on remote, collaborative work.
Monitor and own the progress of clinical studies at investigative sites, ensuring compliance with protocols and regulations.
Coordinate study setup activities, including investigator identification and regulatory submissions, while mentoring junior staff.
Interact directly with clients, manage payments, and participate in proposal activities, with travel up to 50-60%.
Precision for Medicine is a specialized CRO that combines agility with scientific expertise to support innovative clinical development programs. They foster a collaborative environment that values quality, accountability, and professional development, with a global team of experienced professionals.
Perform clinical medical record review and abstraction to support healthcare quality and compliance.
Apply established review criteria consistently and document findings clearly and objectively.
Work independently to complete accurate reviews within project deadlines while managing multiple priorities.
Health Services Advisory Group (HSAG) is transforming the delivery of healthcare in the United States. They are a growing team dedicated to improving healthcare quality, with a focus on community and collaboration.
Audit 30% of production output to identify and flag miscalibration or inconsistent scoring across raters.
Provide clear, actionable feedback and corrections to raters to ensure rating quality and consistency.
Complete onboarding and training ahead of the production pool's rollout to maintain alignment.
Welo Data provides AI services, specializing in data annotation and quality assurance for machine learning projects. They are a growing company focused on building a community of freelance raters and testers, offering flexible remote work opportunities.
Listen to recorded conversations between users and AI voice agents to evaluate response quality.
Rate each agent turn on two scales: content helpfulness and prosody naturalness.
Write short, specific justifications for each score given.
Welo Data is an AI services company that provides evaluation and data services for AI voice agents. They are a global organization with a freelance workforce, focusing on quality assessment of AI interactions.
Review patient data listings and visualizations to confirm eligibility, identify protocol deviations, and data integrity issues.
Assess factors affecting patient safety and clinical data integrity, and escalate serious issues to project team.
Document observations, write queries, and ensure activities meet project objectives and timelines.
Syneos Health is a fully-integrated life sciences services organization that partners with innovators in drug development and commercialization. The company employs over 25,000 people and is committed to developing its people and fostering an inclusive culture.
Create and maintain Study Trackers and monitor screening deadlines.
Review study visits and sweeps for readiness using page status and query reports.
Monitor review progress, identify issues and risks, and report to Lead Central Review Manager.
ICON is a global healthcare intelligence and clinical research organization that accelerates drug development. It is a large, values-driven organization with a focus on integrity, collaboration, agility, and inclusion.
Conduct clinical audits for suspected fraud, waste, and abuse with high autonomy.
Document findings in formal reports, graphs, and audit logs, aligning with unit goals.
Develop and present FWA-related education to Oscar teams, ensuring compliance with regulations.
Oscar is a health insurance company built on a full stack technology platform, focused on serving members like a doctor in the family. Founded in 2012, it is a forward-thinking company that values diversity and innovation, with a culture of fostering belonging and support.