Design and own the datasets and evaluation specifications for financial-domain LLMs, vision-language models, and AI agents, focusing on unstructured and multimodal financial data.
Translate customer goals into concrete dataset specifications, taxonomies, rubrics, and acceptance criteria, ensuring domain validity and statistical defensibility.
Develop evaluation methodology beyond surface accuracy, covering numerical consistency, hallucination rates, refusal appropriateness, and fairness across customer segments.
Design and own the quality of clinical datasets for training and evaluating health AI models.
Collaborate with cross-functional teams to translate customer goals into dataset specifications and evaluation plans.
Ensure clinical realism, statistical defensibility, and compliance in health AI evaluation workflows.
Innodata is a global data engineering company that enables the responsible advancement of artificial intelligence. With over 36 years of legacy, they deliver high-quality data and outstanding outcomes for AI builders and adopters.
Own and extend the offline eval suite across AI products, including datasets, judges, and metrics.
Build and maintain online quality dashboards tracking resolution rate, CSAT, LLM-as-judge signals, and more.
Close the production feedback loop by mining failure patterns and translating data into product decisions.
Finom is a European tech startup headquartered in Amsterdam, developing an all-in-one financial B2B platform integrating banking, accounting, and invoicing. With over $346 million in total funding and a team of hundreds, they foster a start-up culture focused on innovation, swift implementation, and user impact.
Apply deep financial expertise to develop and evaluate AI systems for financial reasoning.
Create, review, and refine finance-related prompts and analytical tasks for AI training.
Assess AI-generated outputs for accuracy, logic, and relevance in quantitative finance and risk modeling.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. It operates as a partner for contract-based roles, focusing on innovative finance and technology projects.
Apply your financial expertise to enhance the quality and reliability of AI-generated financial content by creating and refining prompts and case studies.
Evaluate AI outputs for accuracy in valuation, modeling, forecasting, and financial reasoning, identifying errors and providing structured feedback.
Collaborate with distributed project teams to ensure consistent quality standards and timely delivery of complex financial analyses.
This role is listed on behalf of a partner company, who manages all applications and next steps. The work is fully remote and designed for specialists who enjoy analytical problem-solving in a fast-evolving environment.
Design and deliver high-quality AI evaluation data initiatives, from proposals through pilot execution and production readiness.
Recruit and manage subject-matter experts across technical domains, ensuring rigorous quality control frameworks.
Act as key interface with AI lab partners, converting pilots into scaled production engagements.
Jobgether uses AI-powered matching to connect candidates with roles quickly and fairly. They are a remote-first company that shares top-fitting candidates with hiring partners.
Evaluate financial documents and verify information accuracy for AI model training.
Respond to prompts with financial expertise to help AI understand complex fiscal concepts.
Provide data validation and expert feedback to bridge human financial knowledge and machine learning.
Prolific is building the largest pool of quality human data in the world, serving over 35,000 AI developers and researchers. They connect researchers with a global pool of participants for ethically sourced human behavioral data, focusing on integrating diverse human perspectives into AI development.