Source Job

$215,000–$325,000/yr
US

  • You'll build the self-improvement loop end to end: capture evidence, propose improvements, evaluate them, and deploy what helps.
  • You'll own the skill runtime and the pipeline from session history to new skills, memories, and review surfaces.
  • You'll build evals, sharing, versioning, and provenance so improvements are proven, safe, and portable.

LLM Retrieval Evals Prompt Engineering

20 jobs similar to Founding Engineer

Jobs ranked by similarity.

Unlimited PTO

  • Own the research roadmap for recursive self-improvement and ship what works into production.
  • Design agent strategies, exploration policies, and evaluations for autonomous LLM research systems.
  • Partner with applied scientists and build production-quality experiments end to end.

Sequen builds Recursive Ranking Intelligence (RRI), an autonomous engine where AI agents perform ML research in clients' clouds or on Sequen-hosted instances. It is a small, highly technical, early-stage team turning AI advances into production ranking systems.

$170,000–$220,000/yr
US

  • Own the context layer: manage what Mimo knows, when, and at what cost, with retrieval and memory as one budget.
  • Define tool contracts and build evaluation practice: schemas, results, failure modes, and regression gates for every change.
  • Shape how Mimo reasons, asks, explains, and recovers, and decide which model runs where.

MimoLabs builds Mimo, an agentic system for making physical things, from design to production across 3D printing, CNC, and laser cutting. We are a small, VC-funded, experienced team based in Detroit and remote across the US, fast, adaptable, and honest.

$110,000–$130,000/yr
US

  • Build speech and text pipelines, LLM workflows, and integrations the client runs on.
  • Deploy to the client's cloud, instrument what you ship, and fix what breaks.
  • Write the tests, evals, and docs that keep it working after the engagement ends.

Lunon is an AI-native consulting firm that embeds engineers inside businesses to ship software. The team is young, fast-moving, and owns what they ship end to end, working with the newest tools.

AI Engineer

Elicit
$185,000–$320,000/yr
US 4w PTO

  • Build evaluations to measure and improve AI reasoning in complex, high-stakes decisions.
  • Collaborate with engineers, product, and domain experts to turn observed failures into testable improvements.
  • Own the quality of shipped systems, from code reviews to monitoring and integration.

Elicit builds AI systems that help research and business teams make evidence-based decisions on high-stakes questions. They are a remote-friendly, collaborative team that values rigorous thinking, experimentation, and in-person retreats.

US Unlimited PTO 16w maternity 16w paternity

  • Build shared SDKs, APIs, and infrastructure for AI features and agentic workflows.
  • Integrate durable execution infrastructure for long-running agent workflows, including checkpointing, retries, and human-in-the-loop steps.
  • Develop evaluation and debugging tools that turn production failures into measurable improvements and regression coverage.

Vanta helps businesses automate security monitoring and demonstrate trust through compliance with standards like SOC 2, HIPAA, and ISO 27001. Founded in 2018, it has a kind, talented team and thousands of customers worldwide.

Global

  • Learn, maintain, and improve our synthetic data pipeline and automated training system.
  • Take over a model and improve it with an agent loop that generates its own data.
  • Build closed loops where agents train detectors, test against validation sets, and improve with little human input.

CVEDIA builds computer vision models and applications that run on server and edge hardware using synthetic data. We are a small, fully remote team that uses AI agents across the company.

$215,000–$325,000/yr
US

  • Design and build the agent runtime, including dispatch, execution lifecycle, tool calling, and error handling.
  • Build the extension system and trust boundary, ensuring safe default actions and auditable permissions.
  • Design the context system and inference layer, with provider abstraction and observability.

Yaklabs is building a desktop AI application that turns knowledge workers into AI power users. The small, high-intensity team is funded and led by industry veterans.

$190,000–$270,000/yr
US

  • Take new AI products from idea to production
  • Talk to users and turn vague needs into clear workflows and designs
  • Build the tools used to test, evaluate and monitor agents

They are a late-stage, venture-backed enterprise AI company shipping new AI products from zero to one. They are assembling a small, high-ownership team focused on speed, product judgment, and customer impact.

Global 7w PTO

  • Build and own evaluation infrastructure for Circle's AI agents.
  • Diagnose quality breakdowns across the agent pipeline.
  • Grow datasets and lead the AI Quality engineering team.

Circle builds an AI-powered all-in-one platform for digital businesses, uniting audiences with discussions, live streams, events, chat, courses, and payments. It's a fully remote team of about 270 people from 30+ countries, with an async culture and annual global offsites.

$125,000–$250,000/yr
UK US

  • Automate manual factory processes end to end with AI agents.
  • Build and improve the platform every agent runs on.
  • Work closely with operators and finance to ship real-world tools.

CircuitHub is reshaping electronics manufacturing with The Grid, a factory-scale robotics platform for small-batch, high-mix assembly. Backed by $45M from Plural, Y Combinator, and Google Ventures, they are profitable and scaling fast.

  • Interact with AI models across a wide range of prompts and topics.
  • Compare AI-generated responses side by side to assess quality.
  • Write clear, well-reasoned explanations supporting your evaluations.

Anyone AI creates high-quality training and evaluation data for frontier AI models. They work with remote independent contractors, focusing on expert human evaluation to improve AI accuracy and reliability.

US

  • Design, build, and deploy AI agents that automate Mind Moves' internal operations, from contractor onboarding to market-rate research.
  • Decompose workflows into agent architectures—skills, tools, evals, memory, and orchestration—and build evaluation frameworks that measure and improve agent quality.
  • Own the full lifecycle from identifying workflows to prototyping, deployment, monitoring, and iteration, creating reusable infrastructure and documentation.

Mind Moves is a women-owned Washington, D.C.-based consultancy that helps businesses and governments design, build, and deploy human-in-the-loop AI solutions. It is a small, entrepreneurial team of AI pioneers that has delivered products serving millions of users and worked with Fortune 500 corporations and large government entities.

  • Architect AI infrastructure including backend services, data pipelines, and orchestration workflows for LLMs.
  • Write production-grade, high-performance code for high-throughput AI workflows and data-driven systems.
  • Integrate foundational models, vector data stores, and cloud microservices into scalable platform components.

Korza builds AI infrastructure and products, specializing in LLM and agent-based systems. The company emphasizes cross-functional collaboration and rapid shipping of cutting-edge AI capabilities.

AI Engineer

Mastra
North America Europe

  • Build tools for understanding traces, evaluating agent behavior, and turning results into improvements.
  • Run experiments on Mastra's primitives to find where they fall short and improve configuration and behavior.
  • Help turn findings into capabilities developers can use in their own applications.

Mastra is the open-source TypeScript framework for building AI agents. We're a small, fully remote team backed by Y Combinator and Spark Capital with $35M raised.

Global

  • Design and ship features end to end across data model, API, background workers, and UI.
  • Build and improve agent and model evaluation: sandboxed trials, scoring, and trustworthy aggregation of thousands of runs.
  • Improve benchmark task quality checks, integrate new models and agents, and keep the system fast and reliable as usage grows.

Turing accelerates superintelligence by providing high-quality datasets, reinforcement learning environments, and research benchmarks to frontier AI labs, and also deploys agentic AI systems for Fortune 500 enterprises. Headquartered in San Francisco, it operates with startup speed and an AI-forward culture.

Europe 6w PTO

  • Own agent quality end-to-end for Bliro's chat and voice agents, including prompting, context, and model evaluation.
  • Build eval sets, LLM judges, and benchmarks to measure quality, latency, and cost with statistical rigor.
  • Establish a repeatable process for improving agent quality and set the long-term technology roadmap.

Bliro builds an AI assistant that handles desk work for field sales teams, with over one million customer touchpoints documented. Backed by leading investors and trusted by German Mittelstand companies, it's a small, high-performing team that values ownership and continuous improvement.

US

  • Build AI-powered agents and tools end-to-end: identify problems with clients, prototype quickly, evaluate rigorously, and ship to production.
  • Design and implement LLM integrations including prompt engineering, function calling, structured outputs, and retrieval-augmented workflows.
  • Work directly with clients to understand workflows, validate AI behavior, and iterate toward production quality.

Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. With over 1,500 firms in 60 countries and nearly $10 trillion in assets on the platform, Addepar fosters a culture of ownership, collaboration, and continuous learning.

  • Own AI agents and autonomous workflows powered by LLMs from problem framing through production.
  • Build RAG pipelines, set evaluation and guardrail standards, and optimize for cost and scalability.
  • Work directly with client teams to scope problems and deploy AI systems in their environments.

Acceler is a Forward-Deployed Engineer company that takes AI from pilot to production inside client systems. With a practitioner network of nearly 1,000 engineers across the US and India, it's a high-caliber team built on ownership, trust, and rapid learning.

US Unlimited PTO 16w maternity 16w paternity

  • Plan, build, and improve background-agent infrastructure that enables reliable, trackable, and repeatable automated engineering work.
  • Develop systems for evaluating agent performance using task outcomes, quality measures, human intervention, cost, and other signals.
  • Improve how engineers discover, understand, and use shared AI tools and workflows, and create clear guidance and documentation.

Vanta helps businesses earn and prove trust through automated security monitoring and a leading Trust Management Platform. Founded in 2018, the company has a kind, inclusive, and talented team, and thousands of companies rely on Vanta for real-time security and compliance.

$30–$60/hr
Global

  • Design realistic legal tasks based on professional legal research, contract analysis, litigation support, and regulatory review workflows.
  • Analyze contracts, statutes, regulations, and case law to develop evaluation criteria for AI agents.
  • Review AI-generated legal analyses for accuracy, completeness, jurisdictional relevance, and logical consistency.

Anyone AI creates high-quality training and evaluation data for frontier AI models. They provide contract opportunities for experts to contribute to AI development.