Model Test and Measurement Engineer
Benefits
Unlimited PTO
14w maternity
14w paternity
Similar Jobs
See allSenior Data Scientist, AI Evaluation
Alpaca
Americas
Python
SQL
Machine Learning
Content Specialist III | AI Evaluation & Prompting
Partner Company
United States
Writing
Editing
Prompt Engineering
Machine Learning Engineer (Governance ML Platform)
Partner Company
EMEA
PostgreSQL
Python
Software Engineering
Applied AI Engineer
TLDR
US
LLM
Claude Code
Python
AI Analytics Technical Lead
General Dynamics Mission Systems, Inc.
US
SQL
Python
Data Integration
About the Role:
- You will own the evaluation framework for a mission-critical AI platform, ensuring models perform as intended.
- You will build labeled ground truth datasets, design audits, and measure model performance across releases.
- You will produce evidence packages that support deployment decisions and maintain independence from build roles.
Requirements:
- 5+ years of model validation experience as a named responsibility.
- Direct experience with ground-truth construction and sampling design, plus strong Python and SQL.
- US citizenship and active Secret clearance required.
What We Offer:
- Fully remote, results-based environment with a competitive salary, bonus, and equity package.
- 100% employer-paid medical, dental, and vision insurance for you and your family.
- Unlimited PTO and 14 weeks of fully-paid parental leave.
DEFCON AI
DEFCON AI leverages artificial intelligence, mathematical optimization, and data analytics to help organizations optimize complex systems and manage disruptions. The company offers a fully remote, results-based environment with unlimited PTO, comprehensive benefits, and a focus on empowering employees to work independently.