Source Job

North America Europe

  • Build tools for understanding traces, evaluating agent behavior, and turning results into improvements.
  • Run experiments on Mastra's primitives to find where they fall short and improve configuration and behavior.
  • Help turn findings into capabilities developers can use in their own applications.

TypeScript AI Agents LLM Evaluation Experimentation

20 jobs similar to AI Engineer

Jobs ranked by similarity.

Austria

  • Build and maintain AI agent harnesses: tool calling, agent loops, context management, structured outputs.
  • Develop reusable tools and modules for AI across model types and sizes.
  • Design resilient systems for network failures, model errors, timeouts, and retries.

This company develops AI harness and peer-to-peer technology to enable local AI at scale. It is a fully remote, globally distributed engineering environment valuing autonomy, technical curiosity, and continuous innovation.

$200,000–$320,000/yr
US

  • Prototype and test ideas for applying AI to data and marketing workflows.
  • Develop and ship production-ready AI applications in close collaboration with product and engineering teammates.
  • Make architectural and framework decisions for LLM-based systems and build data agents that answer analytics questions.

This is a Series D marketing technology company focused on building AI experiences that help teams use data to improve marketing workflows. They are a small, fast-paced product and engineering team within a venture-backed startup environment.

$180,000–$400,000/yr
Global

  • Own the agentic development environment, ensuring AI agents can operate autonomously in cloud-based environments and execute full test suites.
  • Build MCP server integrations to connect agents to internal systems like CircleCI, Slack, Datadog, and GitHub.
  • Drive enablement by owning repo-wide agent documentation and developing tooling for engineers and non-engineers.

Hightouch is a data activation platform that helps companies sync customer data to their business tools. It is a remote-first startup with a fast-paced, high-ownership culture.

North America

  • Design and architect next-generation AI agents for observability that transform incident investigation and remediation.
  • Drive technical direction, architecture, and best practices using AI/ML models to reduce mean time to resolution.
  • Collaborate with cross-functional teams and mentor engineers to deliver secure, scalable features.

ServiceNow is an AI platform that connects AI, data, and workflows to help enterprises work smarter and faster. The company serves 85% of the Fortune 500 and fosters an AI-native culture where technology and talent are unstoppable.

Global

  • Evaluate AI-generated coding interactions end to end for correctness and engineering judgment.
  • Assess whether outputs reflect strong engineering taste and provide clear, opinionated feedback.
  • Help define what great looks like for AI coding tools like Codex, Claude Code, and Cursor.

G2i Inc. is a technology staffing company that connects software engineers with remote contract opportunities. The company values engineering excellence and provides flexible, ongoing projects for senior-level developers.

US Unlimited PTO

  • Lead the engineering strategy and execution for evaluations of AI agents, owning the core evaluation platform.
  • Design scalable evaluation infrastructure, APIs, workflows, and production systems across software categories.
  • Mentor and develop a team of engineers as the technical authority on agentic evaluation.

This company focuses on building credible, scalable evaluations of AI agents from software vendors. It operates as a fully remote, inclusive team with a flexible culture and a focus on professional growth.

North America

  • Design and build production-grade AI agentic systems for web and chat experiences.
  • Architect agent workflows involving reasoning, tool use, retrieval, guardrails, and monitoring.
  • Build LLM evaluation systems and diagnose agent performance issues across prompts and tools.

Netomi is an agentic AI platform for enterprise customer experience, enabling automation for global brands. Backed by Y Combinator and Index Ventures, the company drives efficiency and higher quality experiences.

Turkey

  • Ship real features in production using coding agents like Claude Code, Cursor, and Copilot, setting intent and owning the outcome.
  • Keep the codebase and context lean by maintaining standards, architecture notes, and feeding SAST findings back for real patches.
  • Build team-level tooling, review AI-assisted pull requests, and share workflows that improve how everyone works with agents.

Insider One is a marketing and customer engagement platform that unifies data, personalization, and journey orchestration across channels. The company is powered by 1500+ employees across 30+ offices, and is recognized as a woman-founded, women-led B2B SaaS unicorn.

US

  • Design and deploy AI agents that automate sales, operations, and support workflows.
  • Own technical delivery end-to-end, from architecture to production and post-launch improvements.
  • Work directly with clients to understand workflows and explain technical tradeoffs.

Stello is an AI transformation firm that partners with mid-market and enterprise companies to automate repetitive work with AI agents. They work across sales, operations, and customer support, deploying solutions inside existing client tools.

Latin America

  • Build production Agentforce agents including topics, actions, grounding, guardrails, and evaluation harnesses.
  • Implement actions across Flow, Apex, prompt templates, and external APIs, grounding answers in Data 360.
  • Design guardrails against prompt injection and data leakage, and run evaluation and regression tests before changes.

AspenView Technology Partners builds high-performing nearshore IT teams for North American clients, focusing on innovation and efficiency. They are a people-first, purpose-driven company that believes great culture drives great outcomes.

Canada Unlimited PTO

  • Design and deliver production-grade agents that investigate, reason, and act on live observability data.
  • Own agent work from rough prototype to production, including evals.
  • Extend the agentic workspace with new canvas capabilities, MCP server, and skills.

Honeycomb provides an observability platform that helps engineers understand and debug complex systems. It is a fully distributed company of over 200 people, with a culture that values impact, autonomy, and inclusivity.

North America 3w PTO

  • Develop, configure, deploy, and optimize AI agents using Cresta's AI platform and tools.
  • Build AI agent integrations with external systems such as APIs, databases, and CRMs to ensure seamless workflow integration.
  • Collaborate with customers and internal stakeholders to gather technical requirements and translate business needs into AI agent solutions.

Cresta builds a unified AI platform that combines conversational AI agents, real-time human agent augmentation, and conversation intelligence to drive revenue and efficiency for customer experience channels. Born from Stanford AI Lab, the company has raised over $270 million from top investors and is led by AI industry veterans.

$170,000–$215,000/yr
US

  • Build the internal AI stack hands-on: agents, MCP connectors, prompt libraries, and governed knowledge for engineering, product, and design.
  • Own experiments end-to-end in a dedicated AWS environment with Terraform, shipping what works and driving adoption.
  • Drive behavior change across the org through enablement, training, and an operating rhythm.

BetterHelp is on a mission to make mental health care more accessible, as the world's largest online therapy service with over 30,000 licensed therapists. Founded in 2013, we're a diverse, mission-driven team that deeply invests in employee well-being and professional development.

Europe US

  • Maintain and evolve platform foundations, tools, and processes for agentic development to keep n8n operating as an AI-native engineering organization.
  • Build and integrate agentic workflows across Linear, GitHub, CI, and developer review processes while ensuring safety and security.
  • Define quality metrics, benchmarks, and adoption signals to measure agent output and improve engineering productivity.

n8n is an open workflow orchestration platform built for the new era of AI, giving technical teams the freedom of code with the speed of no-code. Since 2019, the company has grown to over 260 employees across Europe and the US, with a community of 650,000+ developers, 190K+ GitHub stars, and a $5.2bn valuation.

Global

  • Develop and deploy cutting-edge AI/ML solutions to enhance the platform and improve student learning experiences.
  • Design, develop, and optimize LLM-powered agentic systems and APIs for real product use cases.
  • Collaborate with senior engineers and contribute to evaluation frameworks and MLOps pipelines.

Interview Kickstart specializes in interview preparation and career transitions into high-demand tech fields like AI, ML, and Data Science. Over 17,000 tech professionals have been guided by current and former hiring managers to land coveted positions at companies like Google and Amazon.

UK

  • Build tooling for capturing and processing data from agents and humans at significant scale.
  • Solve hard problems around compute, orchestration, scaling, security, and reliability.
  • Help develop approaches for training, benchmarking, and evaluating AI agents.

Prolific builds human data infrastructure for AI development, connecting researchers with a global pool of participants to collect high-quality, ethically sourced behavioral data. They are a mission-driven company at the forefront of AI innovation, with a remote culture and a focus on impactful work.

$100,000–$250,000/yr
US Unlimited PTO

  • Own the AI coding agent's context and harness system design.
  • Own online and offline evals for the agent.
  • Leverage 100k+ users and 200k+ repos to guide experimentation.

Hercules builds an AI coding agent designed to make developers more productive. It is a startup with a founding team in San Francisco that values speed, excellence, and a bias for action.

Brazil

  • Design and develop specialized AI agents using Generative AI, LLMs, and agentic frameworks like LangChain and Semantic Kernel.
  • Build MCP servers and integrate AI applications with event-driven architectures, ensuring secure and traceable decisions.
  • Implement Human-in-the-Loop workflows and apply PromptOps practices for scalable, secure, and high-impact AI solutions.

The hiring company is a technology organization in Brazil focused on building AI-powered applications and agentic systems. It fosters a collaborative and international culture, with fully remote work and opportunities to work on innovative AI technologies.

Global 7w PTO

  • Own product features end-to-end, from problem statement to production.
  • Write specs with AI agents and critically review their code in complex systems.
  • Deliver reliable features handling financial transactions and evolve AI-first development.

Social Discovery Group creates social entertainment platforms that connect people online across cultures, addressing loneliness and disconnection. The company's international remote team works from everywhere, and it earned 'Great Place to Work' recognition in 2024-2025.

$86,400–$151,200/yr
Europe

  • Transform an existing AI agent product into scalable, reliable infrastructure.
  • Design and operate the core agent runtime, including orchestration, memory, and multi-agent workflows.
  • Work directly with the founder to set architecture, engineering standards, and development culture.

An early-stage AI infrastructure startup transforming a working AI agent product into scalable infrastructure. As the first engineering hire, you'll work directly with the founder to shape engineering culture and standards from the ground up.