Similar Jobs
See allPrincipal Software Engineer, AI & Platform
Koala Health
US
Ruby On Rails
AWS
AI
Principal Engineer, AI
Brightwheel
US
AI
Ruby On Rails
PostgreSQL
Principal Software Engineer
TTEC Digital
Global
Go
Python
TypeScript
Software Engineering Manager
Cority
Canada
.NET Core
C#
JavaScript
Principal AI Engineer
Egen
US
Python
Google Cloud
LangChain
Role Overview:
- Architect and build production systems across a multi language stack: C#/.NET services, Python AI and data pipelines, and occasional TypeScript.
- Set the example for an AI forward, high technical standard across the broader engineering organization, leading through craft rather than organization wide authority.
Responsibilities:
- Design and drive adoption of offline evaluation frameworks (test suites, golden datasets, regression harnesses wired into CI/CD) for LLM based and other non deterministic components.
- Build online evaluation and monitoring that continuously assesses live model and system behavior in production, including drift and regression detection.
- Partner with engineering leadership to surface systemic risks in AI features, such as reliability, correctness, and drift, and drive the fixes.
Qualifications:
- 8+ years of professional software engineering experience with Staff, Principal, or Architect-level scope.
- Depth across backend and AI/ML systems working in C#/.NET, Python, and TypeScript.
- Experience with LLM observability, prompt and response evaluation, or agentic system testing.
RxSense
RxSense is a healthcare technology company that provides platforms and solutions to improve the management and access of cost-effective pharmacy benefits. As a leader in SaaS technology for healthcare, they offer innovative solutions with integrated intelligence on a single enterprise platform.