Source Job

$130,000–$175,000/yr
Global

  • Build and ship LLM-powered applications and AI agent workflows.
  • Design systems for reasoning, planning, memory, tool use and multi-step execution.
  • Build evaluation frameworks to measure AI quality and reliability.

Python LLM APIs Vector Databases

20 jobs similar to LLM Application Engineer

Jobs ranked by similarity.

  • Build and ship AI features end-to-end, from model to system to user experience.
  • Design and iterate on prompts, tools, memory, and agent workflows for real-world reliability.
  • Debug full-stack issues and optimize for latency, cost, and production performance.

A1 builds a proactive smart assistant for everyday users, bringing intelligence to conversations, errands, organizing, and workflows with minimal prompting. The team is small, world-class, and focuses on rapid iteration and shipping high-quality AI products.

United States

  • Design and implement production-ready AI capabilities that improve reasoning, accuracy, and explainability.
  • Optimize autonomous agent workflows and Retrieval-Augmented Generation pipelines for performance.
  • Develop evaluation frameworks and benchmark datasets to measure AI effectiveness and drive continuous improvement.

LTS builds an AI-native engineering platform for modernizing mission-critical healthcare systems serving millions of Veterans. The engineering team is intentionally small, giving every engineer meaningful ownership and direct influence over product direction.

US Unlimited PTO

  • Collaborate with product and engineering teams to translate product objectives into autonomous agent-based solutions.
  • Design and build new agent data types, pipelines, and frameworks to coordinate reasoning, function calling, and actions.
  • Develop and optimize autonomous agents leveraging LLMs, planning algorithms, and multi-step reasoning approaches.

PointClickCare is a leading health tech company that helps providers deliver exceptional care. As a founder-led, privately held company with over 30,000 provider organizations and 400+ integrated partners, they are recognized by Forbes as a top private cloud company and honored as one of Canada's Most Admired Corporate Cultures, offering flexibility and growth opportunities.

$160,000–$240,000/yr
US

  • You will build AI-assisted tools, workflow automations, agents, prompts, and integrations to reduce manual effort and improve productivity.
  • You will partner with business stakeholders to understand high-friction workflows and deliver fit-for-purpose AI solutions.
  • You will implement engineering controls for data handling, access management, prompt safety, and output validation.

Shield AI is a venture-backed defense-tech company that develops intelligent systems, including Hivemind autonomy software and V-BAT and X-BAT aircraft, to protect service members and civilians. With offices across the U.S., Europe, the Middle East, and Asia-Pacific, the company's technology supports operations worldwide.

Global

  • Build and maintain MCP servers, tool definitions, and context management capabilities.
  • Design and implement intent evaluation, classification, and routing workflows.
  • Integrate Anthropic and OpenAI models into production environments.

Applaudo designs, builds, and scales AI-powered solutions that create real business impact. They foster a high-performance culture grounded in values such as empowerment, collaboration, and transparency.

US

  • Design and build agentic AI systems to automate complex workflows across ICON's software platform.
  • Develop LLM-powered features using state-of-the-art foundation models and APIs.
  • Architect multi-agent pipelines, tool-use systems, and MCP integrations.

ICON is a construction technology company that develops advanced 3D printing and robotic systems for building homes and structures. The company fosters an innovative, inclusive, and diverse work environment with a focus on pushing the boundaries of construction technology.

Global

  • Build internal agentic workflows end-to-end on OpenRouter, from prototype to production, automating support and GTM operations.
  • Integrate our systems with the tools the company runs on, and steadily replace those tools where it makes sense.
  • Own the reliability of what you ship: evals, guardrails, and monitoring, so automation is trustworthy rather than flashy.

OpenRouter is an AI routing and infrastructure layer that provides a unified API for AI builders and enterprises to access and manage AI usage. They are a small team where every person has direct impact on product and users.

Global

  • Design and maintain LLM-powered backend services using Python and FastAPI.
  • Implement retrieval-augmented generation (RAG) for structured and unstructured fleet data.
  • Optimize retrieval accuracy, latency, and hallucination rates through automated evaluation pipelines.

Datakrew revolutionizes EV fleet intelligence with IoT and AI solutions. They aim to serve one million EVs within 5 years and cultivate a mission-driven culture.

US

  • Build agents with real authority over real workflows, not just Q&A toys.
  • Design typed, intent-routed tools over MCP for scale and performance.
  • Develop the evaluation harness to measure and improve agent quality.

Rootstock Software is building an AI-first ERP for manufacturing, replacing traditional UI with agent-driven interactions. They have a deep bench of senior engineers, real products and customers, and a culture of experimentation and mutual growth.

US

  • Build and maintain production AI agents that power customer success workflows.
  • Define success metrics and evaluation frameworks before writing code.
  • Deploy, monitor, and iterate on agentic solutions to improve customer outcomes.

Samsara provides a Connected Operations Cloud platform that enables organizations to harness IoT data to improve safety, efficiency, and sustainability. As a recently public company, they foster a culture of autonomy and support in a hyper-growth environment focused on long-term impact.

India

  • Design and develop production-grade LLM applications using Python and FastAPI.
  • Build and optimize retrieval-augmented generation pipelines with LangChain or similar frameworks.
  • Implement prompt engineering strategies and evaluate AI systems for accuracy and performance.

Our partner is an innovative engineering team building advanced AI solutions that transform how businesses interact with complex operational data. They offer a fully remote work environment with opportunities to work on cutting-edge technology and collaborate with global teams.

US Europe Middle East

  • Build asynchronous Python/TypeScript services with FastAPI, Pydantic, and asyncio.
  • Develop agent orchestration, subagent delegation, tool calling, and structured outputs.
  • Create behavioral evals and regression datasets using Langfuse.

We are a venture-backed defense-tech company building AI-native intelligent software for sovereign institutions and their affiliated organizations. We have offices across the U.S., Europe, and the Middle East, and we are expanding our engineering team with people who demonstrate strong ownership and sound judgment.

$120,000–$170,000/yr
US

  • Design, develop, and maintain LLM-powered applications and autonomous agents using Python and frameworks like LangGraph.
  • Build agentic workflows, implement prompt engineering strategies, and integrate LLM models across providers.
  • Develop observability tools, MCP Server components, and deploy cloud-native solutions on AWS.

NBCUniversal is one of the world's leading media and entertainment companies, creating and distributing content across film, television, and streaming, and operating theme parks. As a subsidiary of Comcast Corporation, the company champions an inclusive culture and strives to develop a talented workforce to serve communities.

$200,000–$300,000/yr
US Unlimited PTO

  • Design, build, and own agentic systems that produce client-ready financial deliverables from data ingestion to polished output.
  • Build evaluation and quality systems for generated deliverables, including deterministic checks and model-judged review.
  • Turn proprietary data into evidence-backed insight by building pipelines that discover and verify patterns.

Farsight is the agentic AI platform for financial services, helping investment banks and private equity firms automate nuanced workflows. The team comes from leading financial institutions and tech companies, focusing on hiring the best to become the best.

$120,000–$170,000/yr
US

  • Design, build, and maintain automated AI evaluation pipelines for production LLM applications.
  • Develop prompt engineering strategies and evaluate model performance using quantitative methods.
  • Analyze production AI behavior with Python, SQL, and statistical techniques to identify improvement opportunities.

GovWorx provides an AI-powered platform, CommsCoach, that supports 9-1-1 and emergency communications centers by automating quality assurance, training, and real-time call evaluation. The company is a growing technology team focused on public safety, collaborating across AI, engineering, product, and data science.

$159,300–$230,000/yr
US

  • Architect and build end-to-end GenAI applications using Python, LangChain, and LlamaIndex on Google Cloud.
  • Develop advanced RAG pipelines and Semantic Search systems for production-level accuracy.
  • Optimize LLM and Embedding fine-tuning while applying MLOps best practices for scalability.

Egen is a fast-growing and entrepreneurial company with a data-first mindset, using advanced technology platforms like Google Cloud and Salesforce to drive client impact through data and insights. We are dedicated to learning and innovation, with a culture that values engineering expertise and solving tough problems.

Ireland

  • Build AI-powered workflows, assistants, and automation systems for financial services.
  • Apply AI across customer support, CRM, onboarding, and operations.
  • Work with product and engineering teams to turn manual processes into AI-native systems.

We believe people deserve smarter ways to plan, save and grow their money. We are a mobile-first insurance platform in Southeast Asia with teams of over 20 nationalities.

Singapore

  • Build AI agents, workflows, and automations that solve real customer and operations problems.
  • Apply LLMs, retrieval, and tool calling to practical financial workflows.
  • Create AI-assisted experiences for onboarding, support, KYC, and risk review.

We are the leading insurance platform in Southeast Asia, helping people plan, save, and grow their money. With over 20 nationalities working remotely and from offices, we are expanding to offer spending, saving, investing, and more.

US

  • Design, develop, and deploy production-ready generative AI and machine learning applications.
  • Collaborate with cross-functional teams to integrate AI capabilities into business systems.
  • Apply prompt engineering, retrieval-augmented generation, and evaluation strategies to optimize AI performance.

The company is a technology firm specializing in AI transformation initiatives. It fosters a collaborative culture centered on learning, innovation, and professional development.

Global

  • Own and build evaluation pipelines for AI workflows to define metrics, benchmarks, and acceptance criteria.
  • Drive continuous improvement of AI performance through quantitative analysis, prompting strategies, and workflow design.
  • Ensure reliability, monitoring, and stability of AI systems with dashboards, alerts, and failure detection.

HiPeople is an AI Hiring Platform that automates screening, interviews, assessments, and references for recruiting teams. They are a lean startup backed by leading investors, aiming to reach $10M ARR with fewer than 20 people, and work with brands like the NFL and Zapier.