About The Role:
- This role focuses on side-by-side (SBS) evaluation of outputs from different AI models across real-world scenarios.
- You will play a key role in improving how AI systems understand and communicate in French.
- It is an evaluation and analysis role requiring strong judgment and attention to detail.
Responsibilities:
- Apply detailed, scenario-specific annotation guidelines.
- Maintain consistency and high-quality evaluations.
- Perform side-by-side (SBS) comparisons of AI-generated responses.
Required Qualifications:
- Native or professional fluency in French.
- Strong English reading comprehension (required for guidelines).
- Prior experience with side-by-side (SBS) labeling or annotation.
Training & Qualification:
- Training sessions and practice exercises.
- Calibration against quality benchmarks.
- Qualification review before moving into production work.
Blueprint Technologies
Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and an expanding footprint across Latin America (LATAM). They are united by a shared passion for solving complex problems and bring diverse perspectives, deep expertise, and real-world experience across industries to help organizations grow, transform, and innovate.