Data Scientist
Benefits
Unlimited PTO
Similar Jobs
See allNew Product Owner – Medical Cost Containment & JIRA Expertise
Reliant Health Partners
US
JIRA
Agile Methodologies
User Story Writing
Recruiter - High Volume - LTE
Cielo
US
Recruiting
Boolean Search
Microsoft Office
Oracle CPQ Senior Consultant
Apex IT
Colombia
Implementation
Client Management
Web Engineer
Monzo
UK
React
Vue
Angular
Sales Manager
Siteminder
SaaS Sales
CRM
Communication
Key Responsibilities:
- Evaluation Response Quality: Design and own evaluation harnesses for LLM and agentic outputs, build LLM-as-judge pipelines, and track response-quality metrics.
- Adversarial Robustness Testing: Red-team the system against prompt injection, jailbreaks, and tool-misuse; characterize failure modes and feed them into guardrails.
- Retrieval Agentic Trajectory Analysis: Evaluate retrieval quality and analyze multi-step agent trajectories for tool-call correctness and guardrail-breach behavior.
Why us:
- Comprehensive medical, dental, and vision plans with 401(k) employer match.
- Flexible Paid Time Off and Volunteer Time Off to support work-life balance.
- Paid parental leave and a 5-year Service Milestone Sabbatical.
ScienceLogic
ScienceLogic is redefining IT operations for the modern enterprise with an AIOps platform that enables self-healing, self-optimizing systems. The company helps enterprises and service providers achieve unified visibility across hybrid and multi-cloud environments, accelerating digital transformation through automation, AI, and analytics.