Senior LLM Systems Engineer

WHY THIS ROLE EXISTS:

• Own and improve the LLM-driven components of our oracle automation stack.
• Focus on the accuracy, performance, resilience, and operational quality of the systems.

WHAT YOU'LL OWN:

• LLM Accuracy: improve prompts, model selection, structured outputs, retrieval, and evaluation coverage.
• System Performance: reduce latency, token usage, and cost while preserving decision quality.
• Resilience: design validation, retries, fallbacks, uncertainty handling, and human review paths.

WHAT SUCCESS LOOKS LIKE:

• The oracle automation system handles a wider range of market and resolution scenarios with higher measured accuracy.
• LLM quality is tracked through evaluations and regressions instead of judged only through manual spot checks.
• Engineers and operators can inspect model behavior, tool usage, reasoning paths, and uncertainty when investigating outcomes.