Senior Product Manager - EMEA - Remote
Remote regions
EMEABenefits
5w PTO
Similar Jobs
See allSenior Product Owner (Application Experience)
Unknown
Europe
Product Management
AI
Data Analysis
Product Owner (Recommendation Systems)
Social Discovery Group
Global
Product Management
Data Analysis
A/B Testing
Product Manager
Privacy
United States
Product Management
Data Analysis
Unit Economics
Product Marketing Manager (Testora)
Partner Company
Global
Market Research
Data Analysis
AI Tools
Lead Product Manager - Behavioural
YouGov
US
Product Management
SaaS
Analytics
About the Role:
- You will own the Evals Quality charter, defining success metrics and improving creative quality across Pencil's agentic system.
- You will build and maintain the judging methodology, rubric design, and golden dataset to ensure reliable measurement.
- You will partner with commercial teams to provide evidence for client RFPs and enablement packages.
Key Responsibilities:
- Define core quality metrics like first-pass-right and coverage, and drive them up.
- Design the human QC mechanism and calibration process between automated judges and human raters.
- Run the full product lifecycle from discovery through post-launch audit with written hypotheses.
What We Offer:
- 25 days PTO plus public holidays, with a flexible time off scheme.n- Health insurance, wellness stipend, and enhanced parental leave policies.n- Fully remote role with flexible hours and access to London office if desired.
Pencil
Pencil is an advertising technology company using Generative AI to redefine content creation for brands. Founded in 2018 by former Google, Facebook and Uber employees, it is backed by Sequoia and now part of The Brandtech Group, fostering a fast-moving, human-centric culture.