Source Job

$170,000–$220,000/yr
US

  • Build and deploy AI-powered solutions using LLMs and automation frameworks across business and engineering teams.
  • Support model evaluation and cost visibility for AI/LLM spend and tooling.
  • Maintain agent infrastructure and deliver training and enablement to improve AI fluency across the organization.

LLMs APIs Cloud Infrastructure Data Pipelines

20 jobs similar to AI Operations Engineer

Jobs ranked by similarity.

Global

  • Design and build the AI execution platform with event-triggered workflows and model-agnostic runtimes.
  • Develop evaluation layers with golden test suites and safety checks to ensure AI reliability.
  • Implement governance mechanisms and build AI agents supporting business workflows.

Jobgether is a platform that connects talent with opportunities using AI-powered matching. The company has a globally distributed team and a remote-first culture.

Hungary

  • Evaluate incoming AI use cases and assist teams in selecting appropriate LLM models.
  • Balance technical quality, security, compliance, availability, and cost considerations.
  • Manage the LLM catalog including service requests, approvals, access, credentials, quotas, and onboarding processes.

Deutsche Telekom IT Solutions, a subsidiary of Deutsche Telekom Group, provides comprehensive IT and telecommunications services. With over 5,300 employees, the company has won awards for educational cooperation and ethical practices, fostering a culture of continuous development.

$136,000–$176,000/yr
US

  • Drive adoption of the agentic AI platform across departments, serving as technical SME and champion for rollout.
  • Establish AI financial observability by creating dashboards to track costs and optimize fiscal efficiency.
  • Govern AI vendor risk assessment and build repeatable IT operational workflows for long-term support.

Virta Health is on a mission to reverse metabolic disease in one billion people through innovations in technology, personalized nutrition, and virtual care. The company has raised over $350 million from top-tier investors and partners with major health plans, employers, and government organizations.

US Unlimited PTO

  • Architect and deploy autonomous AI agents and multi-agent workflows for privacy-first systems.
  • Build scalable backend services using FastAPI and orchestrate agentic workflows with LangGraph in AWS or Azure.
  • Develop rigorous evaluation pipelines for accuracy, citation adherence, latency, and reliability.

Osano is a leading data privacy platform that helps organizations comply with global privacy regulations like GDPR and CCPA. Backed by top-tier investors and recognized as a Great Place to Work for four years running, the company has a 97% employee satisfaction rate and a mission-driven, fast-growing culture.

AI Engineer

BPD
US

  • Build and enhance LLM-powered analytics features such as natural-language querying, retrieval-augmented generation, and agentic workflows over structured and unstructured healthcare data.
  • Contribute to text-to-SQL and semantic-layer systems enabling non-technical users to query complex datasets accurately and safely.
  • Develop retrieval pipelines using vector search and hybrid keyword+semantic methods while implementing evaluation, guardrails, and hallucination checks for compliance.

BPD is a strategic growth partner that provides integrated branding, marketing, communications, and business consulting solutions for healthcare brands. The company fosters an inclusive culture that values diversity, collaboration, and continuous learning.

US Unlimited PTO 16w maternity 16w paternity

  • Design and deliver production-grade agents that investigate, reason, and act on live observability data.
  • Own the agent work from rough prototype to production-grade, including evals and full-stack development.
  • Extend the surface area in Canvas, the MCP server, and Canvas Skills, distinguishing hype from signal.

Honeycomb is an observability platform that helps developers understand their systems. With over 200 employees and a Series D funding, we foster a culture of impact, inclusivity, and autonomy.

$280,000–$420,000/yr

  • Own AI operations and governance across the enterprise, ensuring systems are reliable, compliant, and secure.
  • Provide hands-on technical leadership in model evaluation, tuning, and troubleshooting alongside program oversight.
  • Build and lead a team responsible for AI sustainment, including strategic planning and executive communication.

Shield AI builds autonomous systems for defense and aerospace. As a growing company, it emphasizes a culture of innovation and technical rigor, seeking leaders to operationalize AI governance.

$152,100–$190,100/yr
US

  • Identify and map workflows to find step-change opportunities for AI automation.
  • Design and build future-state workflows using agents, integrations, and human-in-the-loop checkpoints.
  • Deploy and run agents in production, tracking KPIs and iterating on performance.

Natera is a global leader in cell-free DNA testing, focusing on oncology, women's health, and organ health. The company employs a diverse team of dedicated professionals from world-class institutions, fostering a collaborative and inclusive culture.

$138,500–$225,500/yr
US 16w maternity 16w paternity

  • Design, train, and ship ML systems for governance and security like anomaly detection and trust scoring.
  • Build data pipelines, model serving, evaluation frameworks, and feedback loops.
  • Set technical direction, own architecture, and help recruit and mentor as the team grows.

Docker provides developer tooling trusted by over 20 million monthly users and billions of container pulls. They are a globally distributed, remote-first team building tools for software delivery.

Global

  • Ship the agent platform to production: event-triggered queue, model-agnostic runtime, durable state, human review gate, atomic rollback, and complete run logging.
  • Own the evaluation layer with golden suites, behavioral assertions, safety cases, and a CI gate that blocks regressions before merging.
  • Enforce governance in code: risk tiers, least-privilege credentials, permission gates, audit log, and autonomy classes where dangerous actions are structurally impossible.

Supabase is the Postgres development platform providing a complete backend solution including Database, Auth, Storage, Edge Functions, Realtime, and Vector Search. With ~400 team members across 60+ countries, we are a born-remote, open-source-first company that builds tools developers love.

US

  • Design, develop, and deploy AI-powered productivity and automation solutions using Microsoft Copilot Studio and AI tools like Claude.
  • Build and support scalable solutions with Power Apps, Power Automate, and integrations, ensuring compliance with strict data controls.
  • Troubleshoot technical issues, mentor teammates, and stay current with emerging AI platforms to drive continuous improvement.

Pyrovio is a consulting firm that helps organizations use Microsoft Power Platform, Copilot, and AI tools to improve productivity and automate workflows. They are a growing company with a high-performing, client-focused team offering deep expertise in regulated environments.

$133,000–$184,000/yr
US 22w maternity 12w paternity

  • Contribute to internal AI platforms like Archimedes, Bosun, and easyRAG to help teams scale LLM-powered applications.
  • Build reusable platform capabilities such as APIs, SDKs, and templates for safe, high-quality AI tools.
  • Collaborate with Security, Risk, and Legal to implement guardrails for responsible AI development.

Chime is a financial technology company, not a bank, that offers user-friendly banking services to help everyday Americans achieve financial progress. They are a team of problem solvers and builders with a mission-driven culture, serving millions of members.

Global

  • Own and build evaluation pipelines for AI workflows to define metrics, benchmarks, and acceptance criteria.
  • Drive continuous improvement of AI performance through quantitative analysis, prompting strategies, and workflow design.
  • Ensure reliability, monitoring, and stability of AI systems with dashboards, alerts, and failure detection.

HiPeople is an AI Hiring Platform that automates screening, interviews, assessments, and references for recruiting teams. They are a lean startup backed by leading investors, aiming to reach $10M ARR with fewer than 20 people, and work with brands like the NFL and Zapier.

US

  • Lead a high-performing AI and data science team to develop and deploy AI-driven security systems.
  • Define and execute the technical roadmap for AI, ML, and data systems, ensuring robust performance and scalability.
  • Manage the entire lifecycle of data pipelines and AI models, integrating with platforms like AWS Bedrock and OpenAI.

Bugcrowd is a crowdsourced security platform that unites organizations with a global network of hackers to identify vulnerabilities. The company is backed by prominent investors and fosters a collaborative, inclusive culture with a diverse team of professionals.

US 4w PTO

  • Design and deliver production-ready AI solutions including machine learning, generative AI, and LLM applications.
  • Translate complex business needs into scalable technical architectures and implementation plans.
  • Guide clients and cross-functional teams through discovery, architecture, and adoption of AI systems.

This company partners with organizations to deliver AI and data transformation solutions. It fosters a collaborative, remote-first culture focused on innovation, inclusivity, and meaningful impact.

Spain Sweden UK Ireland Germany 6w PTO

  • Build core backend services for context ingestion, indexing, and retrieval in a new AI-native data intelligence system.
  • Design scalable multi-tenant SaaS architecture and agent-facing APIs for reliable context retrieval.
  • Operate what you build using observability tools, and contribute to technical direction and architecture.

Grafana Labs is the company behind the open observability cloud, Grafana, which helps organizations monitor and act on their data. They are a 100% remote company with over 1,600 team members across 40+ countries, fostering a culture of transparency, collaboration, and open source.

$86,870–$112,420/yr
Canada

  • Design, build, and operate production AI systems, including agent orchestration and retrieval pipelines.
  • Architect and maintain marketing databases, pipelines, and the Customer Data Platform for advanced analytics.
  • Automate workflows with AI, ensuring data quality and reliability across end-to-end pipelines.

Samsara is the pioneer of the Connected Operations™ Cloud, enabling organizations to harness IoT data to improve the safety, efficiency, and sustainability of their physical operations. It is a publicly-traded company with a culture of autonomy and support, encouraging rapid career development and a scrappy, fast-moving team environment.

US Unlimited PTO 14w maternity 14w paternity

  • Work directly with customers to understand their workflows and operational constraints.
  • Build and deploy AI-enabled applications, agents, and workflow automation using LLM techniques.
  • Own delivery from prototype to production, including architecture, backend services, and integrations.

Trase Systems provides an end-to-end platform for deploying and optimizing AI in the enterprise, focusing on bridging the 'last mile' of AI adoption. As a startup founded in 2023, the team is small, agile, and collaborative, with a strong emphasis on innovation and direct customer impact.

$130,000–$175,000/yr
Global

  • Build and ship LLM-powered applications and AI agent workflows.
  • Design systems for reasoning, planning, memory, tool use and multi-step execution.
  • Build evaluation frameworks to measure AI quality and reliability.

Gina's Tech Jobs is an IT staffing and recruiting agency that specializes in placing technology professionals. They partner with companies to fill roles such as this one, offering a wide range of positions.

United States

  • Design, build, and maintain enterprise AI platform capabilities for LLMs, AI agents, RAG, and GenAI applications.
  • Develop reusable AI harnesses and evaluation frameworks to automate testing, model benchmarking, and quality assurance.
  • Implement observability, LLMOps pipelines, and scalable backend services using cloud-native and containerized architectures.

LTS provides technology solutions supporting high-visibility federal missions. The company values innovation, growth, and collaboration.