Similar Jobs
See allTask Development Engineer
METR
Global
Software Engineering
Attention To Detail
Python
AI Interaction Evaluator (Codex / Claude Code)
Jobgether
US
Python
TypeScript
JavaScript
Document / Deck Production QA Evaluator
Jobgether
Canada
Quality Assurance
Microsoft Office
Google Workspace
AWS Serverless & IaC AI Task Auditor - Freelance AI Trainer
World Wide
Global
AWS
Terraform
CloudFormation
Senior Software Engineer - LLM Trainer
Toloka
US
Python
JavaScript/TypeScript
Go
Task Evaluation:
- Assess technical accuracy and reproducibility of software engineering tasks.
- Ensure tasks are solvable and supported by reliable tests.
- Identify codebase integration issues or logic errors.
Technical Auditing:
- Provide clear, actionable feedback on task deficiencies.
- Test scenarios to verify practical applicability.
- Maintain high standards for AI training workflows.
Required Expertise:
- Demonstrable professional experience in software engineering.
- Strong analytical and problem-solving skills.
- Familiarity with SWE-Bench standards and complex codebase navigation.
Work Environment:
- Fully remote freelance contract.
- Flexible hours with pay based on experience.
- No company-sponsored benefits; bring your own equipment.
Project World Wide
Project World Wide sources experienced technical specialists for AI training task auditing. This freelance contract opportunity focuses on ensuring technical rigor and accuracy in AI workflows.