AI Benchmark Engineer | Native Language Specialist - Spanish (Mexico)

About the Opportunity:

• We are building a rigorous evaluation suite to test LLMs on multilingual software challenges.
• You will create high-signal tasks that measure multilingual handling without relying on English translation.

What You’ll Deliver:

• Task Engineering for coding agents, including asset creation and prompting translation.
• Implementation verification with robust solutions and deterministic verifier scripts.
• Calibration execution to analyze logs and set task difficulty across model tiers.

Qualifications:

• 5+ years of industry software engineering experience with strong Python and shell scripting.
• Native fluency in Spanish (Mexico) and deep understanding of encoding, Unicode, and locale conventions.
• Experience with Terminal/CLI workflows and familiarity with coding agents.

Why Collaborate with Lilt:

• Work as an independent contractor with flexible hours, no fixed schedule, and no micromanaging.
• Get paid quickly and fairly with competitive rates on projects that advance AI and language technology.
• Join a global community of experts and contribute to cutting-edge multilingual AI development.