Similar Jobs
See allAI Research Scientist
Unknown
US
Python
LLMs
Reinforcement Learning
Research Engineer
Gauntlet
US
Python
Machine Learning
AI Agents
AI Research Scientist
Unknown
US
Python
AI/ML
LLMs
AI Engineer
Elicit
US
Python
Evaluation Design
Software Engineering
Lead Engineer, AI Quality
Circle
Global
Ruby On Rails
Python
LLM Agents
Responsibilities:
- Design and lead an end-to-end evaluation framework for planner-executor agents.
- Define scenario schemas, grading specifications, and validation processes.
- Develop an LLM-powered user simulator for realistic multi-turn conversations.
Requirements:
- Demonstrated experience with LLM and AI agent evaluation methodologies.
- Hands-on experience building production-grade planner-executor systems.
- Strong expertise in experimental design and statistical inference.
Benefits:
- Annual salary range of $200,000–$300,000.
- Remote work opportunity within the United States.
- Customer-facing, research-driven work with substantial ownership.
Jobgether
Jobgether is an AI-powered job matching platform that connects candidates with hiring companies. It uses technology to match applications and share top-fitting candidates with employers.