Similar Jobs
See allSenior Software Engineer - LLM Trainer
Toloka
US
Python
JavaScript/TypeScript
Go
Data Scientist
Sonatype
US
Python
Machine Learning
LLMs
Machine Learning Engineer
Docker
US
Machine Learning
Artificial Intelligence
Software Engineering
AI Engineer/ML Engineer - Senior Developers - AI Training
Prolific
Global
Python
PyTorch
TensorFlow
New Software Engineer, Infrastructure, Interpretability
Anthropic
US
Python
Cloud Infrastructure
Kubernetes
About the Role:
- You'll work closely with our research team to prepare benchmark datasets and build evaluation pipelines.
- You'll turn research methodology into systems that run consistently and reproducibly.
- Evaluations draw on the knowledge domains our expert network covers.
What You'll Do:
- Prepare and maintain benchmark datasets.
- Build and maintain evaluation pipelines and environments.
- Develop analysis tools and leaderboards.
What You Bring:
- Solid engineering skills with 4+ years experience and strong Python.
- Data rigor and comfort with Docker.
- Collaborative spirit and ability to work with researchers.
Office Hours
Office Hours is an on-demand expert network that connects leading organizations with trusted experts across various knowledge domains. We're a hyper-growth and profitable company, quickly expanding our expert network, launching new offices, and new products.