Source Job

$200,000–$300,000/yr
United States

  • Lead the development of a rigorous evaluation framework for enterprise AI agents, including experimental methodology and production-quality tools.
  • Design and execute statistically sound experiments to assess planner models, execution models, and inference optimization strategies.
  • Provide technical leadership, establish evaluation standards, and deliver actionable recommendations supporting enterprise deployment decisions.

LLM Python Customer-facing

20 jobs similar to Principal Applied Scientist

Jobs ranked by similarity.

$130,000–$200,000/yr
US

  • Develop AI methods and algorithms for reliable agents.
  • Design simulations and evaluations for agent behavior.
  • Partner with product and engineering to ship research.

The company builds an AI agent platform focused on making agents reliable in production. It is a research-driven environment with a collaborative, startup-oriented culture.

$175,000–$195,000/yr
US Canada Unlimited PTO 12w maternity 12w paternity

  • Build evaluation frameworks for AI agents, including datasets and metrics for real-world task performance.
  • Design experiments to compare models and tools, identifying regressions and trade-offs.
  • Investigate agent failures and improve performance across models, harnesses, and tooling.

Gauntlet builds the financial systems of the future, operating across the onchain finance stack to offer vault products. They serve over $1.7B in client TVL across fintechs, protocols, exchanges, and capital allocators, combining traditional finance and crypto-native expertise.

$130,000–$200,000/yr
US

  • Develop and improve methods, algorithms, and systems across the lifecycle of reliable AI agents.
  • Create new approaches for simulating, evaluating, and optimizing agent behavior in real-world settings.
  • Partner with product and engineering teams to bring AI research into practical applications.

The company builds infrastructure for reliable AI agents in production, targeting enterprise workflows. It is a focused team of researchers and engineers working collaboratively on advancing agentic AI.

AI Engineer

Elicit
$185,000–$320,000/yr
US 4w PTO

  • Build evaluations to measure and improve AI reasoning in complex, high-stakes decisions.
  • Collaborate with engineers, product, and domain experts to turn observed failures into testable improvements.
  • Own the quality of shipped systems, from code reviews to monitoring and integration.

Elicit builds AI systems that help research and business teams make evidence-based decisions on high-stakes questions. They are a remote-friendly, collaborative team that values rigorous thinking, experimentation, and in-person retreats.

Global 7w PTO

  • Build and own evaluation infrastructure for Circle's AI agents.
  • Diagnose quality breakdowns across the agent pipeline.
  • Grow datasets and lead the AI Quality engineering team.

Circle builds an AI-powered all-in-one platform for digital businesses, uniting audiences with discussions, live streams, events, chat, courses, and payments. It's a fully remote team of about 270 people from 30+ countries, with an async culture and annual global offsites.

US Unlimited PTO 17w maternity 17w paternity

  • Build AI applications, agents, skills, connectors, and workflow automations that solve business problems.
  • Translate ambiguous business needs into AI-native workflows and own engineering from discovery to production launch.
  • Work closely with internal teams to embed AI solutions and drive measurable gains in quality, speed, and cost.

Reddit is a community of communities built on shared interests, passion, and trust. With 100,000+ active communities and about 130 million daily active visitors, it is one of the internet's largest sources of information.

Global

  • Build and improve AI agents by writing production code for Voice Agent and Autopilot platforms.
  • Own enterprise AI deployments from initial discovery through go-live, working directly with customers.
  • Design and implement AI workflows, debug agents in production, and turn customer needs into reusable product features.

Supermove builds software and AI for moving companies, providing systems for sales, operations, crews, and billing. The company has raised $30M from investors like Andreessen Horowitz and serves moving businesses across the US, Canada, and Australia.

$111,000–$167,000/yr
US Unlimited PTO

  • Build and test LLM, RAG, and agent-based workflows.
  • Evaluate models against quality, latency, and cost metrics.
  • Create and maintain evaluation datasets and test cases.

Definitive Healthcare transforms data and analytics into actionable intelligence for the healthcare industry. With a global team and over 2,400 clients, we maintain a collaborative, inclusive culture that has earned multiple workplace honors.

$185,000–$260,000/yr
US

  • Own the agent runtime every Superhuman runs on: planning, tool calling, memory, guardrails, and the trust ladder.
  • Design multi-agent orchestration, including handoffs across the customer journey, shared state, and conflict resolution.
  • Build the eval harness for agent behavior, define the platform surface, and run a weekly ship cadence with GenAI and engineering.

1mind is building Autonomous Customer Experience software, deploying AI 'Superhumans' that handle go-to-market tasks across the entire buyer journey with continuous memory. The company fosters a supportive, inclusive environment and believes 'Every1 Wins' when the buyer wins.

US Unlimited PTO

  • Design, build, and maintain agentic features across products from early prototype to scaled production.
  • Develop thorough evaluation frameworks covering accuracy, grounding, latency, and reliability using offline evaluations and real-world signals.
  • Embed privacy-by-design principles across the AI stack ensuring compliance and secure handling practices.

Osano is a leading data privacy platform that helps organizations comply with laws like GDPR, CCPA, and other global privacy regulations. The company is a B-corporation with a mission to make privacy a fundamental right, backed by top-tier investors and recognized as a Great Place to Work for four years running with 97% of employees saying it's a great place to work.

US

  • Analyze customer pain points and opportunities with an analytical, customer-centric lens to identify friction in the customer experience.
  • Build and maintain production LLM-based agents and automations, integrating with systems like Salesforce and writing clean Python code.
  • Deploy and monitor agent performance, tracking accuracy, latency, and customer outcomes while iterating continuously.

Samsara is the pioneer of the Connected Operations Cloud, enabling organizations that depend on physical operations to harness IoT data for actionable insights. It is a recently public company with a culture that emphasizes winning together, celebrating together, and supporting each other, valuing high-impact builders.

$180,000–$225,000/yr
US

  • Design and build LLM-powered agents and workflows including orchestration, tool use, retrieval, structured extraction, and human-in-the-loop review.
  • Build evaluations with data labelers and subject matter experts, running them on every change to ensure reliability.
  • Make agents production-grade by implementing guardrails, observability, cost and latency optimization, and careful handling of sensitive health data.

CCC Intelligent Solutions Inc. is a leading cloud platform for the multi-trillion-dollar insurance economy, creating intelligent experiences for insurers, repairers, automakers, and more. With over 35,000 businesses using its technology, the company focuses on innovation and collaboration to keep lives moving forward.

US Unlimited PTO

  • Own the vision for applied AI solutions across Reddit's business and technical functions.
  • Build AI applications, agents, and automations that solve real business problems.
  • Mentor engineers and set technical direction for AI-native workflows.

Reddit is a community of communities, hosting open and authentic conversations on the internet. With 100,000+ active communities and approximately 130 million daily active unique visitors, it is one of the internet's largest sources of information.

$190,578–$249,400/yr
US

  • Own the end-to-end architecture for AI products, including model selection, multi-agent orchestration, and retrieval systems.
  • Lead implementation of shared AI services, SDKs, and platform standards for production AI systems.
  • Provide technical leadership, mentoring, and stakeholder management to deliver high-impact AI initiatives.

RealPage provides software and AI solutions for the real estate and property management industry. It is a large organization that emphasizes innovation, engineering excellence, and responsible AI in a collaborative culture.

$150,000–$300,000/yr
Global

  • Build and post-train agents for scientific research, including literature search, code execution, and domain tool use.
  • Develop RL and multi-agent methods for proposing, testing, and critiquing hypotheses, with strong baselines and evaluation.
  • Design verifiers, reward signals, and reproducible experimental loops for scientific workflows, ensuring evidence-based improvements.

Prime Intellect builds the open superintelligence stack, providing infrastructure for frontier AI labs to train, evaluate, and deploy models at scale. The company has raised $150M from top investors and operators, and is building a culture focused on frontier research, real infrastructure, and go-to-market for a new category.

$275,000–$290,000/yr

  • Leads AI/ML R&D, owning evaluation science across every agent and building predictive models for churn, demand, and payment recovery. - Drives model economics through distillation, caching, and cost optimization to reduce cost per successful task. - Sets enterprise eval methodology including golden-set design, sampling, and statistical thresholds to catch regressions before customers do.

Xplor provides cloud-based technology solutions for small and medium-sized businesses, including payment processing. The company is unified by its purpose of helping people succeed.

$275,000–$300,000/yr
US Europe

  • Set technical direction for production agent systems, including orchestration, tool use, memory management, and failure recovery.
  • Build and operate shared foundations: evaluation frameworks, observability, execution controls, and model access with routing and failover.
  • Work with security and platform teams to ensure scoped permissions, data isolation, audit trails, and safe execution of tools and code.

Cobalt runs AI agents in production that test real customer applications, operating at the forefront of the pentesting industry. The company is rapidly expanding, offering a collaborative culture with mentorship, competitive compensation, and a focus on growth.

$182,000–$325,000/yr
US

  • Lead the GTM AI Engineering team, building AI agents, copilots, and workflow automations for Sales, Customer Success, Support, and Enablement.
  • Spend about 70% of your time hands-on building (prototyping agents, writing code, designing evals) and 30% leading strategy and influencing stakeholders.
  • Own the GTM AI platform architecture, evaluation frameworks, model routing, and adoption across the field.

Samsara is the pioneer of the Connected Operations Cloud, enabling organizations that depend on physical operations to harness IoT data for actionable insights. As a recent public company, Samsara values autonomy, long-term thinking, and a growth mindset, with a flexible remote-first culture.

$200,000–$320,000/yr
US

  • Rapidly prototype AI applications to explore new ways to support data and marketing workflows.
  • Work closely with a small team and senior leaders to develop and ship product ideas.
  • Build production data agents that use company data to answer analytics and data science questions.

They build AI-powered tools for data and marketing workflows. They are a small, high-growth startup with a high-velocity product engineering culture.

APAC

  • Design end-to-end LLM evaluation plans for business scenarios such as dialogue and financial trading.
  • Build evaluation metric systems, rubrics, and high-quality datasets with credible, reproducible conclusions.
  • Analyze model limitations, automate evaluation workflows, and collaborate to drive model improvement.

Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. Trusted by over 300 million people in more than 100 countries, the company offers a fast-paced, results-driven culture with a flat structure and world-class talent.