Similar Jobs
See allForward Deployed Engineer
Surge AI
Global
Research Scientist
Anyone AI
United States
Human Data Evals Lead
Jobgether
United States
Program Management
Quality Engineering
LLM Evaluation
Director, Research - AI Evals
Figma
United States
AI Evaluation
Research
Product Management
Applied Data Scientist, Finance AI Evaluation & Datasets
Innodata
United States
Python
SQL
Pandas
Role:
- Work at the cutting edge of LLM development by designing datasets that shape frontier model behavior.
- Partner directly with AI research teams to experiment with data collection strategies.
What We're Looking For:
- Deep curiosity about data and obsession with how structure, quality, and selection influence LLM performance.
- Bias toward insight and iteration, designing lightweight experiments for actionable results.
- Desire to shape AI development by building the foundational data layer.
What You'll Do:
- Research data collection strategies and design high-impact data slices.
- Model annotator behavior and optimize instruction clarity.
- Develop metrics for evaluating dataset quality and impact on model alignment.
Surge AI
Surge AI builds a platform that powers the most powerful AI models in partnership with companies like Anthropic, Google, Microsoft, and Meta. They are a profitable, bootstrapped company focused on human intelligence and data quality.