Similar Jobs
See allJavaScript Specialist - AI Training
Prolific
Global
JavaScript
TypeScript
React
AI SDLC Lead Engineer
T-Systems
Global
Python
Go
Java
Technical AI Trainer
Smart Working
India
AI Coding Tools
Software Engineering
Test Automation
Software Engineer (AI)
Cargo.one
EMEA
Python
SQL
LLMs
AI Engineer/ML Engineer - Senior Developers - AI Training
Prolific
Global
Python
PyTorch
TensorFlow
Key Responsibilities:
- Create and review coding tasks based on real-world software engineering scenarios.
- Write high-quality reference solutions that are correct, clear, testable, and aligned with task requirements.
- Evaluate AI-generated code and responses using structured rubrics.
Core Requirements:
- 5+ years of professional software engineering experience in backend, fullstack, or systems role.
- Strong proficiency in at least one core programming language, ideally Python, JavaScript/TypeScript, Go, Java, C++, or SQL.
- Hands-on experience with Terminal-Bench and comfortable with Git, command line, and development workflows.
Nice-to-Have:
- Experience with Python-heavy workflows, automated testing frameworks, Docker, Linux, bash, or containerized environments.
- Experience with repo-level code reasoning, large codebases, or open-source contributions.
- Background in backend systems, data engineering, DevOps, infrastructure, security, or large codebase.
Toloka
Toloka is a leading expert human data platform for AI agents and LLMs, providing high-quality training data. The company focuses on improving AI models through human feedback and structured evaluation.