Senior Software Engineer II - Applied AI and Evaluations

You Will:

• Own agent quality end-to-end: diagnosis, improvement, and validation across SmartAssist's orchestrator and subagents
• Identify failure modes across quality dimensions factual accuracy, completeness, tone, actionability, and latency and prioritize what to fix
• Drive quality improvements through prompt engineering, context engineering, and RAG retrieval tuning

You Have:

• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
• Deep, hands-on experience with prompt engineering and context engineering, you understand how model behavior changes with framing, structure, and input design
• Strong working knowledge of RAG architectures: chunking strategies, embedding models, retrieval evaluation, and failure diagnosis

Why This Role:

• You will have real ownership, not a supporting role on someone else's roadmap
• SmartAssist is shipping to real users; this work has immediate, visible impact
• You will be part of a fast-moving team that deeply values engineering rigor and actively seeks diverse perspectives