Source Job

US

  • Design state-of-the-art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships.
  • Translate benchmark insights into clear, compelling narratives for customer-facing presentations, technical reports, and go-to-market materials.
  • Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements.

AI/ML Evaluation NLP Experimental Design Communication Cross-functional Collaboration

6 jobs similar to Research Lead, Open Benchmarks Grants

Jobs ranked by similarity.

$163,000–$280,000/yr
US

  • Own Open Benchmarks Grants end-to-end, leading operations for Snorkel’s $30M commitment to open benchmarks.
  • Lead external research partnerships and manage budgets, resources, and cross-functional execution.
  • Build and scale a multi-year research program, measuring impact to improve future cycles.

Snorkel AI is a frontier AI data lab that helps teams build datasets, benchmarks, and evals for high-performing AI systems. Founded out of Stanford AI Lab in 2019, the company works with leading AI labs and enterprises, offering a fast-paced, collaborative high-growth culture.

Global Unlimited PTO

  • Create and publish coding benchmarks that challenge state-of-the-art frontier agents.
  • Shape the frontier of coding agents and publish impactful studies of interesting findings.
  • Help top AI labs improve their models for coding through benchmarks, open-source tools, and research.

Handshake's mission is to organize expert human knowledge to advance the AI economy, working directly with frontier labs on data, evaluations, and post-training challenges. It is a rapidly growing startup with a small, high-ownership technical team from top AI companies.

US

  • Work at the forefront of AI-powered drug discovery, advancing frontier research and end-to-end applications across discovery, design, and translation.
  • Collaborate with a cross-functional team of top-notch scientists, engineers, and drug hunters to develop scalable biomedical discovery solutions.
  • Apply expertise in machine learning, NLP, and computer vision to turn real-world data into a discovery engine for precision health.

Recursion is a clinical-stage TechBio company decoding biology to radically improve lives through AI-native drug discovery. The company fosters a vibrant, collaborative culture of frontier research and rapid iteration, uniting experts across science, engineering, and business.

US Unlimited PTO

  • Monitor and synthesize trends across AI and machine learning research, foundation models, agents, and data enrichment methods.
  • Tinker with emerging models, tools, and datasets to build prototypes and run experiments that turn ideas into evidence.
  • Identify high-leverage opportunities to enrich data assets and translate research into actionable recommendations.

Troveo builds the data platform AI labs need to train next-generation models, with the world's largest licensed platform of scarce, proprietary data. It is a small, high-impact team backed by top investors, focused on transparency and work-life balance.

US

  • Lead the development of an AI-powered job analysis engine that converts labor market data into structured occupational insights.
  • Build and refine NLP and machine learning models, including embeddings, semantic search, and transformer architectures.
  • Collaborate with product, engineering, and assessment science teams to deliver responsible AI solutions for workforce decisions.

The company builds an AI-powered job analysis platform that transforms labor market data into evidence-based occupational insights. It is a small, innovation-focused remote team that values scientific rigor, collaboration, and responsible AI.

Americas

  • Design AI evaluations: define ground truth, metrics, and scoring methods for models and agents.
  • Build repeatable eval loops to track quality over time and catch regressions before release.
  • Translate eval results into actionable recommendations for system improvements.

Alpaca is a global leader in agent-first brokerage infrastructure, providing APIs for stocks, ETFs, options, crypto, and more. We're a diverse team of 400+ remote-first members backed by $400M in funding, committed to opening financial services to everyone.