Similar Jobs
See allSenior Software Development Engineer in Test (SDET), QA - AI Systems
Nexxa.AI
Global
Python
Test Automation
CI/CD
Software Engineer, Sustaining Automation
Chainguard
North America
Go
AI/LLM
Systems Design
QA Automation Engineer - AI
Anaplan
US
Python
Pytest
API Testing
AI Evaluation Engineer
Jobgether
Global
Python
TypeScript
LLM Evaluation
Marketing Engineer I
GOAT Group
US
Python
LLM APIs
Agent Orchestration
The Role:
- Own quality for non-deterministic AI, building the evaluation harness that underpins governance and shipping confidence.
- Design automated scoring, faithfulness checks, and regression detection for model and agent changes.
What You'll Do:
- Verify grounding so insights trace to real data; build checks to stop hallucinations.
- Red-team for prompt injection and prove multi-tenant data isolation.
Why It Matters:
- Your work decides whether customers trust AI with their money.
- You'll build the evaluation foundation from the ground up with real ownership.
SOFICO Intelligence
SOFICO Intelligence uses AI to extract value from back-office systems, building agentic AI for financial, leasing, fleet, and mobility data. Backed by global ERP leader SOFICO, it's a remote-first team of curious, self-directed builders.