Research Scientist

Responsibilities:

• Turn public benchmarks and eval targets into original evaluation designs.
• Own construct validity, discrimination, headroom, and contamination.
• Build evaluation packages with rigorous QC including calibration layers and deterministic verifiers.

What we're looking for:

• Research background in ML evaluation or benchmarking with published work.
• Deep LLM benchmarking expertise, especially in code-model evaluation.
• Proven ability to hold a team or expert pool to rigorous standards.

Additional details:

• Fluent English required, Spanish a nice to have.
• Reports to CEO.
• Contractor role.