AI Evaluation Engineer

GovWorx

Remote regions

US

Salary range

$120,000–$170,000/yr

Benefits

Similar Jobs

See all

Role Overview:

  • Build and improve AI systems used by public safety agencies across the country.
  • Own evaluation and continuous improvement of production AI systems.
  • Work closely with data scientists, engineers, and product managers.

Key Responsibilities:

  • Design automated evaluation pipelines and prompt experiments.
  • Build offline evaluation datasets and regression testing frameworks.
  • Develop dashboards and reporting for AI quality metrics.

Qualifications:

  • 3+ years in software engineering, ML, data science, or related field.
  • Experience with LLM applications and prompt engineering.
  • Strong Python and SQL skills with statistical knowledge.

Why Join GovWorx:

  • Help build AI systems that directly support first responders.
  • Work on cutting-edge LLM technologies and Responsible AI.
  • Solve technically challenging problems with real-world impact.

GovWorx

GovWorx provides an AI-powered platform, CommsCoach, that supports 9-1-1 and emergency communications centers by automating quality assurance, training, and real-time call evaluation. The company is a growing technology team focused on public safety, collaborating across AI, engineering, product, and data science.

Apply for This Position