Technical Product Manager, Pedagogy & AI Quality

About Medley Learning:

• We build an instructional support tool that layers reading and writing scaffolds onto digital materials for multilingual learners.
• Our scaffolds are grounded in research-backed practices and are already used by over 50 districts across the US.

The Opportunity:

• This role sits at the intersection of pedagogy and AI product work, ensuring high-quality instructional scaffolds.
• You will write prompts, label model outputs, analyze errors, and partner with engineering to ship improvements.
• You will learn about scaffolding for multilingual learners and special education students.

What You'll Do:

• Define quality standards and set targets for AI output quality.
• Track and monitor quality with eval systems, including human labeling and LLM-as-judge.
• Refine prompts, run model comparisons, and prioritize product improvements.

Why Join Medley:

• We are building for underserved populations representing over 20% of U.S. K-12 students.
• You will work directly with founders and engineering leadership, owning meaningful decisions.
• We are committed to a diverse and inclusive work environment.