AI Benchmark Engineer | Native Language Specialist

Role Overview:

• This is a remote freelance opportunity for a native-speaking software or prompt engineer passionate about multilingual AI and rigorous model evaluation.
• You will design realistic Terminal-Bench tasks to test how LLMs handle software challenges in your native language.

Responsibilities:

• Design and engineer challenging benchmark tasks for evaluating coding agents in multilingual terminal environments.
• Create authentic task environments using native language assets and identify model failure points.
• Participate in rigorous quality assurance processes including calibration and audit of benchmark tasks.

Requirements:

• At least 1 year of professional experience in software engineering, prompt engineering, or related field.
• Native or near-native fluency in the target language and strong Python skills.
• Extensive experience with Terminal/CLI environments and understanding of multilingual text processing.