Senior AI Product Manager, Evals & Annotations

What You'll Do:

• Own Arize's Evals & Annotations product area end-to-end, including eval creation and execution, human review, annotation workflows, and the broader evaluation lifecycle.
• Set the product strategy and roadmap, balancing customer needs, foundational platform investments, UX improvements, and emerging opportunities in AI and agent development.
• Drive a best-in-class evaluation experience by developing strong opinions, prototyping solutions, and partnering with Design.

What We're Looking For:

• Significant product management experience independently owning technically complex developer-facing products.
• Strong understanding of LLM evaluations and AI development workflows, including automated evals and human feedback.
• Excellent product and UX instincts, with the ability to define and prototype core product experiences.

Bonus Points:

• Direct experience with LLM evaluation platforms, annotation systems, or agent orchestration.
• Strong backend or platform engineering background.
• Early-stage or high-growth startup experience.