Similar Jobs
See allContent Specialist III
Linda Werner & Associates
US
Fact Checking
Analytical Judgment
Applied AI Engineer
TLDR
US
LLM
Claude Code
Python
Technical Product Lead, AI Email Applications
Confidential
US
AI
Machine Learning
LLM
AI Response Quality Evaluator
Jobgether
Australia
Analytical Thinking
Written Communication
Critical Thinking
Generalist (AI Training Specialist)
Partner Company
India
Critical Thinking
Data Annotation
Content Evaluation
Your Responsibilities:
- Test new AI model versions across diverse topics and evaluate responses against quality standards.
- Write, test, and refine system prompts to influence model behavior and performance.
- Identify and document model failures and provide clear, actionable feedback.
Your Requirements:
- 5+ years of professional experience in writing, editing, or a related discipline.
- At least 1 year of hands-on AI experience including prompting or model evaluation.
- Strong analytical judgment, attention to detail, and ability to apply rubrics consistently.
Your Benefits:
- 6-month remote contract with full-time schedule and comprehensive health coverage.
- Opportunity to work directly on advanced AI system evaluation and improvement.
- Hands-on exposure to prompt engineering and emerging AI products.
Partner Company
This company specializes in evaluating and improving advanced AI systems through content evaluation and prompt engineering. It operates as a partner company managing applications for this role, focusing on quality and consistency in AI behavior.