Source Job

Global

  • Own and build evaluation pipelines for AI workflows to define metrics, benchmarks, and acceptance criteria.
  • Drive continuous improvement of AI performance through quantitative analysis, prompting strategies, and workflow design.
  • Ensure reliability, monitoring, and stability of AI systems with dashboards, alerts, and failure detection.

Go AI/ML LLMs Python CI/CD

20 jobs similar to Applied AI Engineer

Jobs ranked by similarity.

$133,000–$184,000/yr
US 22w maternity 12w paternity

  • Contribute to internal AI platforms like Archimedes, Bosun, and easyRAG to help teams scale LLM-powered applications.
  • Build reusable platform capabilities such as APIs, SDKs, and templates for safe, high-quality AI tools.
  • Collaborate with Security, Risk, and Legal to implement guardrails for responsible AI development.

Chime is a financial technology company, not a bank, that offers user-friendly banking services to help everyday Americans achieve financial progress. They are a team of problem solvers and builders with a mission-driven culture, serving millions of members.

$120,000–$170,000/yr
US

  • Design, build, and maintain automated AI evaluation pipelines for production LLM applications.
  • Develop prompt engineering strategies and evaluate model performance using quantitative methods.
  • Analyze production AI behavior with Python, SQL, and statistical techniques to identify improvement opportunities.

GovWorx provides an AI-powered platform, CommsCoach, that supports 9-1-1 and emergency communications centers by automating quality assurance, training, and real-time call evaluation. The company is a growing technology team focused on public safety, collaborating across AI, engineering, product, and data science.

  • Build and ship AI features end-to-end, from model to system to user experience.
  • Design and iterate on prompts, tools, memory, and agent workflows for real-world reliability.
  • Debug full-stack issues and optimize for latency, cost, and production performance.

A1 builds a proactive smart assistant for everyday users, bringing intelligence to conversations, errands, organizing, and workflows with minimal prompting. The team is small, world-class, and focuses on rapid iteration and shipping high-quality AI products.

Global

  • Build internal agentic workflows end-to-end on OpenRouter, from prototype to production, automating support and GTM operations.
  • Integrate our systems with the tools the company runs on, and steadily replace those tools where it makes sense.
  • Own the reliability of what you ship: evals, guardrails, and monitoring, so automation is trustworthy rather than flashy.

OpenRouter is an AI routing and infrastructure layer that provides a unified API for AI builders and enterprises to access and manage AI usage. They are a small team where every person has direct impact on product and users.

AI Developer

Aphex
Global 4w PTO

  • Build and implement AI features by selecting the right model and approach for each use case.
  • Evaluate and monitor AI feature performance in production to ensure accuracy and reliability.
  • Improve and iterate on prompts and implementations based on how features behave in the wild.

Aphex is a construction execution platform that replaces traditional spreadsheets with collaborative tools for delivery teams. They are a remote-first company with a growing engineering team in the Philippines, serving major contractors on multi-billion dollar projects.

US 24w maternity 24w paternity

  • Build the AI Platform Foundation by leading design and ownership of core infrastructure.
  • Standardize the AI Developer Path by architecting high-level abstractions and APIs.
  • Engineer AI Trust & Safety Systems through monitoring and quality assurance layers.

Smartsheet provides a collaborative work management platform. As a publicly traded company with thousands of employees, it fosters a culture of innovation and inclusion.

Latin America

  • Design and own the playbook for AI productization, governance, and reusable internal tooling.
  • Champion AI-assisted development, TDD, and modern CI/CD practices across the organization.
  • Act as the primary technical authority bridging AI/ML architecture and executive strategy.

RYZ Labs is a startup studio that creates industry-defining companies by leveraging top talent and cutting-edge cloud technologies. Founded in 2021, we have a remote team across the US and Latam, with a culture of autonomy, ownership, and continuous improvement.

Global

  • Work directly with top AI labs to design custom data pipelines and integrations for training and evaluation data.
  • Build technical infrastructure for advanced quality control workflows, including model-in-the-loop and human-in-the-loop systems.
  • Ship fast and iterate constantly, translating ambiguous research needs into high-leverage technical systems.

Surge AI is a platform that powers the most advanced AI models in partnership with leading AI labs like Anthropic, Google, Microsoft, and Meta. Founded by engineers and researchers, the company is profitable from day one without venture funding.

$152,100–$190,100/yr
US

  • Identify and map workflows to find step-change opportunities for AI automation.
  • Design and build future-state workflows using agents, integrations, and human-in-the-loop checkpoints.
  • Deploy and run agents in production, tracking KPIs and iterating on performance.

Natera is a global leader in cell-free DNA testing, focusing on oncology, women's health, and organ health. The company employs a diverse team of dedicated professionals from world-class institutions, fostering a collaborative and inclusive culture.

United States

  • Design and implement production-ready AI capabilities that improve reasoning, accuracy, and explainability.
  • Optimize autonomous agent workflows and Retrieval-Augmented Generation pipelines for performance.
  • Develop evaluation frameworks and benchmark datasets to measure AI effectiveness and drive continuous improvement.

LTS builds an AI-native engineering platform for modernizing mission-critical healthcare systems serving millions of Veterans. The engineering team is intentionally small, giving every engineer meaningful ownership and direct influence over product direction.

US

  • Evolving the AI knowledge platform with retrieval, indexing, and synthesis for organization-wide use.
  • Architecting and operating agentic infrastructure on AWS with cost guardrails and observability.
  • Partnering with product engineering to define the AI platform API surface and building reference agent implementations.

ShiftKey is a healthcare workforce marketplace that connects facilities with licensed professionals to fill shifts, addressing staffing shortages. The company fosters an inclusive and collaborative culture, valuing diverse perspectives.

Global

  • Build LLM-powered software by designing prompt flows and orchestrations to ensure great performance with no false positives.
  • Architect and build a production-grade, testable, and maintainable AI-powered software stack.
  • Design experiments and evaluation frameworks for system performance testing at scale, conducting data analysis to draw conclusions.

XBOW builds an AI-powered platform that autonomously discovers, validates, and exploits vulnerabilities, providing proof-backed results in hours instead of weeks. Founded by the creator of GitHub Copilot and backed by Sequoia and Altimeter, the team includes world-class AI engineers and security researchers.

Ireland

  • Build AI-powered workflows, assistants, and automation systems for financial services.
  • Apply AI across customer support, CRM, onboarding, and operations.
  • Work with product and engineering teams to turn manual processes into AI-native systems.

We believe people deserve smarter ways to plan, save and grow their money. We are a mobile-first insurance platform in Southeast Asia with teams of over 20 nationalities.

Singapore

  • Build AI agents, workflows, and automations that solve real customer and operations problems.
  • Apply LLMs, retrieval, and tool calling to practical financial workflows.
  • Create AI-assisted experiences for onboarding, support, KYC, and risk review.

We are the leading insurance platform in Southeast Asia, helping people plan, save, and grow their money. With over 20 nationalities working remotely and from offices, we are expanding to offer spending, saving, investing, and more.

$160,000–$240,000/yr
US

  • You will build AI-assisted tools, workflow automations, agents, prompts, and integrations to reduce manual effort and improve productivity.
  • You will partner with business stakeholders to understand high-friction workflows and deliver fit-for-purpose AI solutions.
  • You will implement engineering controls for data handling, access management, prompt safety, and output validation.

Shield AI is a venture-backed defense-tech company that develops intelligent systems, including Hivemind autonomy software and V-BAT and X-BAT aircraft, to protect service members and civilians. With offices across the U.S., Europe, the Middle East, and Asia-Pacific, the company's technology supports operations worldwide.

$153,000–$180,000/yr
US

  • Lead end-to-end development of advanced AI solutions including agentic systems, RAG pipelines, and multi-agent workflows.
  • Architect AI infrastructure with guardrails, access controls, and compliance protocols for ethical deployment.
  • Guide multi-disciplinary teams, setting technical playbook and best practices.

Nava is a consultancy and public benefit corporation that makes government services simple and effective. Since 2015, federal, state, and local agencies have trusted Nava to solve technology modernization challenges, and they maintain a collaborative, remote-friendly team environment.

Germany 6w PTO

  • Translate business requirements into concrete AI solutions, working with cross-functional teams to own use cases from idea to production.
  • Work hands-on with enterprise AI tools like Claude Enterprise and ChatGPT Enterprise, building workflows and automations in n8n.
  • Enable data and build a centralized AI platform, integrating LLMs and AI agents into production workflows.

The Quality Group is an innovative provider of sports nutrition products, bringing together successful brands ESN and More Nutrition. With over 1,200 employees, the company combines passion for sports nutrition with cutting-edge technology, production, and logistics.

North America Canada

  • Design and build the agent execution harness, owning the orchestration layer that routes inputs, manages context, and handles multi-step agentic workflows at scale.
  • Ensure reliability, observability, and fault tolerance in production AI systems while optimizing for latency and cost.
  • Lead eval engineering and prompt infrastructure to maintain agent quality and drive data-informed decisions across model updates.

ServiceNow is an AI platform company that automates workflows and helps businesses reinvent themselves through its AI control tower. It serves 85% of the Fortune 500 and fosters an AI-native culture focused on innovation and talent.

US

  • Evaluate AI quality across the advisor stack, including pre-call briefs, in-call guidance, and post-call outputs.
  • Iterate inside ORA by refining prompts, updating knowledge base entries, and tweaking skills to close the loop on issues.
  • Surface trends and drive continuous improvement by tagging conversations, logging issues, and recommending prioritized improvements.

HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership.

$280,000–$420,000/yr

  • Own AI operations and governance across the enterprise, ensuring systems are reliable, compliant, and secure.
  • Provide hands-on technical leadership in model evaluation, tuning, and troubleshooting alongside program oversight.
  • Build and lead a team responsible for AI sustainment, including strategic planning and executive communication.

Shield AI builds autonomous systems for defense and aerospace. As a growing company, it emphasizes a culture of innovation and technical rigor, seeking leaders to operationalize AI governance.