Assessment Design Lead

Role Overview:

• Own assessment design for three types: Curriculum Mastery, Proficiency, and Placement Tests.
• Define constructs like fluency, pronunciation, grammar, and task achievement with clear rubrics.
• Shift from a vague goal to a concrete, scoreable system with the ML engineer.

Responsibilities:

• Define constructs and build rubric/blueprint layers for item writers and scoring models.
• Own validity and quality bar, signing off on content validity and auditing for bias.
• Run validity evidence plans with concurrent/criterion studies against external measures.

Collaboration:

• Partner tightly with Product Manager and ML Engineer on automated scoring and calibration.
• Keep construct and quality bar separate from model implementation.
• Ensure tight loop between construct definition, rubric, and shipped scoring model.