Similar Jobs
See allSoftware Engineer, AI Enablement
Chime
US
Python
Go
TypeScript
AI Evaluation Engineer
GovWorx
US
Python
SQL
Machine Learning
Applied AI Engineer
A1
Python
PyTorch
JAX
Applied AI Engineer
OpenRouter
Global
LLM
Agentic Systems
Backend Development
AI Developer
Aphex
Global
LLM APIs
Prompt Engineering
TypeScript
AI Quality and Reliability:
- Own evaluation systems and quality standards for core AI workflows.
- Define metrics, benchmarks, and acceptance criteria for AI outputs.
- Track performance trends, drift, and regressions.
Continuous Improvement:
- Identify issues across prompts, workflows, and data pipelines.
- Design and implement improvements in prompting, model selection, and orchestration.
- Push AI systems from 80% to 95%+ quality.
Reliability and Monitoring:
- Build and improve monitoring dashboards, alerts, and tracing.
- Detect and prevent failure modes and performance degradation.
- Ensure stable operation at scale.
Testing and Safe Shipping:
- Integrate AI and prompt testing into CI pipelines.
- Define standards for product and engineering teams.
- Act as a quality gate for AI-related changes.
HiPeople
HiPeople is an AI Hiring Platform that automates screening, interviews, assessments, and references for recruiting teams. They are a lean startup backed by leading investors, aiming to reach $10M ARR with fewer than 20 people, and work with brands like the NFL and Zapier.