Work directly with top AI labs to design custom data pipelines and integrations for training and evaluation data.
Build technical infrastructure for advanced quality control workflows, including model-in-the-loop and human-in-the-loop systems.
Ship fast and iterate constantly, translating ambiguous research needs into high-leverage technical systems.
Surge AI is a platform that powers the most advanced AI models in partnership with leading AI labs like Anthropic, Google, Microsoft, and Meta. Founded by engineers and researchers, the company is profitable from day one without venture funding.
Own the design and defense of frontier model evaluations across reasoning, coding, agents, tool use, and multi-modal.
Build benchmark packages with expert-verified ground truth, multi-model headroom results, and rigorous QC.
Recruit, calibrate, and review a pool of subject-matter experts in coding, agentic/tool-use, and STEM/reasoning.
Anyone AI measures frontier model capability through expert-verified evaluation packages. The company operates as a remote team with a focus on rigorous benchmarking and lab collaboration.
Design and deliver high-quality AI evaluation data initiatives, from proposals through pilot execution and production readiness.
Recruit and manage subject-matter experts across technical domains, ensuring rigorous quality control frameworks.
Act as key interface with AI lab partners, converting pilots into scaled production engagements.
Jobgether uses AI-powered matching to connect candidates with roles quickly and fairly. They are a remote-first company that shares top-fitting candidates with hiring partners.
Own AI evaluation methods and operations for Figma's AI-powered experiences, defining quality dimensions and designing measurement frameworks.
Build and maintain evaluation frameworks, rubrics, golden datasets, and quality bars using human and automated approaches.
Produce clear readouts and dashboards to enable stakeholders to make confident shipping decisions.
Figma is on a mission to make design accessible to all, empowering teams to bring ideas to life through collaborative design and prototyping tools. With a growing team of passionate creatives and builders, Figma fosters a culture of growth and inclusivity.
Design and own the datasets and evaluation specifications for financial-domain LLMs, vision-language models, and AI agents, focusing on unstructured and multimodal financial data.
Translate customer goals into concrete dataset specifications, taxonomies, rubrics, and acceptance criteria, ensuring domain validity and statistical defensibility.
Develop evaluation methodology beyond surface accuracy, covering numerical consistency, hallucination rates, refusal appropriateness, and fairness across customer segments.
Innodata is a global data engineering company that enables the responsible advancement of artificial intelligence by providing data, evaluation frameworks, and human expertise. With over 36 years of experience, the company delivers high-quality data and solutions for Generative AI builders and adopters.
Design and own the quality of clinical datasets for training and evaluating health AI models.
Collaborate with cross-functional teams to translate customer goals into dataset specifications and evaluation plans.
Ensure clinical realism, statistical defensibility, and compliance in health AI evaluation workflows.
Innodata is a global data engineering company that enables the responsible advancement of artificial intelligence. With over 36 years of legacy, they deliver high-quality data and outstanding outcomes for AI builders and adopters.
Own growth initiatives end-to-end including GM, platform engagement, workforce recruiting, and reactivation.
Drive data-driven decisions across paid and organic channels while managing cross-functional projects.
Test and experiment with levers to scale contributor acquisition and retention without a playbook.
Surge AI builds a platform that empowers the world's most powerful AI models with human intelligence. They are a profitable, self-funded company with a team of engineers and researchers.
Own and extend the offline eval suite across AI products, including datasets, judges, and metrics.
Build and maintain online quality dashboards tracking resolution rate, CSAT, LLM-as-judge signals, and more.
Close the production feedback loop by mining failure patterns and translating data into product decisions.
Finom is a European tech startup headquartered in Amsterdam, developing an all-in-one financial B2B platform integrating banking, accounting, and invoicing. With over $346 million in total funding and a team of hundreds, they foster a start-up culture focused on innovation, swift implementation, and user impact.
Build and implement AI features by selecting the right model and approach for each use case.
Evaluate and monitor AI feature performance in production to ensure accuracy and reliability.
Improve and iterate on prompts and implementations based on how features behave in the wild.
Aphex is a construction execution platform that replaces traditional spreadsheets with collaborative tools for delivery teams. They are a remote-first company with a growing engineering team in the Philippines, serving major contractors on multi-billion dollar projects.
Review scientific papers and LLM-generated graphical abstracts for accuracy.
Fact-check and identify inaccuracies in AI-generated summaries.
Use domain expertise to verify that technical concepts are correctly represented.
Prolific is building the largest pool of quality human data for AI development, serving over 35,000 developers. They focus on ethical data collection and aim to integrate human perspectives into AI.
Run the full eval pipeline end to end, reproducing results and pairing with senior engineers.
Build a judge calibration protocol to measure agreement and identify drift zones.
Extend benchmarks like GAIA and SWE-bench with new tasks targeting capability gaps.
Nous Research is an AI research lab that develops evaluation infrastructure for LLMs. They are a small, high-growth team valuing ownership and rapid shipping.
Lead technical discovery with foundation model labs, frontier AI teams, and large enterprises to understand model objectives and constraints.
Design end-to-end solutions across the post-training stack including SFT data curation, RLHF/DPO pipelines, custom benchmarks, and LLM-as-judge systems.
Author technical proposals, run workshops and POCs, and serve as ongoing technical advisor during delivery.
Innodata is a global data engineering company focused on enabling responsible AI advancement through data, evaluation frameworks, and human expertise. With a 36+ year legacy, they provide high-quality data solutions to foundation model labs, hyperscalers, and enterprise AI teams.
Own the roadmap and execution for customer workflow products, driving AI-native development and cross-functional collaboration.
Define product requirements and success metrics while conducting continuous customer research to validate decisions.
Partner with engineering and analytics teams on technical decisions, scalability, and integration strategies.
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective skill-based reviews. It is a growing technology company focused on transforming employment access, with a culture emphasizing curiosity, ownership, and collaboration.
Conduct original research on machine visibility, designing studies and analyzing large-scale web crawling datasets.
Build scalable research infrastructure and develop new data collection processes to expand research capabilities.
Collaborate with cross-functional teams to translate findings into actionable insights for product strategy and market positioning.
Our partner is building the research function for machine visibility, exploring how AI systems and autonomous agents interact with the modern web. They operate in a remote-first environment with a culture of autonomy and collaboration.
We are seeking exceptional builders, operators, researchers, designers, and domain experts to help create new data systems for frontier AI.
You may be a fit if you excel at building software, designing expert interfaces, scaling human data programs, or developing evaluation frameworks.
We look for high-agency, fast-learning individuals who care about quality and want to work on the systems that make more capable AI possible.
Aelven is building the next frontier of human data, creating high-quality data for AI labs and frontier AI systems. We are a small, high-agency team focused on expert judgment, intelligent tooling, and data production.
Build and deliver AI-powered features that help users discover, organize, and optimize access to large datasets.
Rapidly prototype, test, and iterate on LLM- and agent-driven workflows with real users to validate ideas early.
Collaborate cross-functionally to integrate AI components with internal tools and ensure scalable, maintainable solutions.
Grafana Labs builds the open observability cloud, providing a fully managed platform that helps organizations see, understand, and act on their data. With over 1,600 team members across 40+ countries, the company fosters a global, remote-first culture rooted in open source and collaboration.
Build and iterate on consumer-facing AI features powered by large language models (LLMs) and generative AI systems
Collaborate with engineers across the AI stack including prompt engineering and agentic workflow optimization
Run structured experiments and monitor production AI systems to optimize latency, cost, and scalability
Quora is a global knowledge sharing platform with over 300M monthly unique visitors, connecting people to share insights and learn. Poe provides a platform for users to chat and build with AI language models. They are a remote-first company with a culture rooted in transparency and experimentation.
Build internal tools and coach-facing features on top of LLMs like Claude and OpenAI.
Turn unstructured conversational data into structured, reliable signals for daily prioritisation.
Own the full stack of what you ship: frontend, backend, model integration, and deployment.
Best10 delivers online, highly personalised diet and lifestyle coaching through WhatsApp and its own platform, working with medical insurers to reduce costs from high-risk members. The company fosters a builder culture where teams ship working AI solutions rapidly and take pride in systems that outlast them.
Develop and improve AI solutions using state-of-the-art machine learning and LLM technologies.
Collaborate with data scientists, product owners, and developers throughout the data-driven development process.
Apply software engineering best practices to build reliable code and conduct code reviews.
Wrike is a work management platform that helps teams collaborate and increase productivity. With over 1,000 employees across 10 global hubs, the company fosters a culture of innovation, collaboration, and customer focus.
Build internal tools and coach-facing features on top of LLMs to turn unstructured conversational data into structured signals.
Design and maintain prompt chains, RAG pipelines, and agent workflows, rapidly prototyping from idea to demo in days.
Wire AI into existing systems, own full stack, and sit with coaches to build for their reality.
We deliver highly personalised diet and lifestyle coaching at scale through WhatsApp and our own technology platform. We partner with leading health insurers and employers, and our culture is about using AI to remove administrative work and enhance the personal coach-member relationship.