Source Job

Global 6w PTO 26w maternity 26w paternity

  • Build production-ready infrastructure for autonomous AI agents, including secure code execution, state management, and model routing.
  • Collaborate with research teams to turn emerging ML ideas into scalable, fault-tolerant distributed systems.
  • Prototype and evaluate new technologies for agent workflows, from identity to resource management.

Machine Learning Distributed Systems Kubernetes

20 jobs similar to ML Infrastructure Engineer

Jobs ranked by similarity.

$140,000–$180,000/yr
Global

  • Build and operate ML infrastructure and platforms powering AI products.
  • Design systems for model training, evaluation, deployment, inference, and experimentation.
  • Optimize model serving and inference infrastructure for high-throughput, low-latency workloads.

US

  • Design and build autonomous AI agents using modern agentic frameworks to analyze infrastructure and make intelligent decisions.
  • Develop and deploy ML models and MLOps pipelines that learn from infrastructure patterns to optimize resource policies and scaling.
  • Own AI systems end-to-end, from architecture to production, ensuring performance, reliability, and cost-effectiveness.

ScaleOps is redefining autonomous cloud and AI infrastructure by freeing DevOps teams from manual resource management, reducing cloud costs by up to 80%. Backed by over $210M from leading VCs, the company is trusted by Fortune 100 companies and fosters an innovative, mission-driven culture.

  • Own AI agents and autonomous workflows powered by LLMs from problem framing through production.
  • Build RAG pipelines, set evaluation and guardrail standards, and optimize for cost and scalability.
  • Work directly with client teams to scope problems and deploy AI systems in their environments.

Acceler is a Forward-Deployed Engineer company that takes AI from pilot to production inside client systems. With a practitioner network of nearly 1,000 engineers across the US and India, it's a high-caliber team built on ownership, trust, and rapid learning.

Global Unlimited PTO

  • Design, build, and evolve systems for distributed model training and batch inference at scale.
  • Develop workflows for experiment tracking, model evaluation, and registry management.
  • Optimize training and inference performance across GPU utilization, data loading, and distributed communication.

NOETIK is a frontier therapeutics company using AI to understand human biology and improve oncology outcomes, building foundation models on proprietary multimodal data. It fosters a collaborative, interdisciplinary culture focused on solving hard problems together.

EMEA

  • Build and maintain production-grade machine learning infrastructure for AI governance and trust, including model serving, evaluation, and monitoring.
  • Develop low-latency inference systems, model registries, and evaluation pipelines for reliable model lifecycle management.
  • Design and implement red-team testing, drift monitoring, and continuous retraining loops using telemetry and audit data.

The company builds AI governance and trust infrastructure, including production ML systems for AI agents. It offers a remote-first, international engineering organization with a focus on security and reliability.

  • Architect AI infrastructure including backend services, data pipelines, and orchestration workflows for LLMs.
  • Write production-grade, high-performance code for high-throughput AI workflows and data-driven systems.
  • Integrate foundational models, vector data stores, and cloud microservices into scalable platform components.

Korza builds AI infrastructure and products, specializing in LLM and agent-based systems. The company emphasizes cross-functional collaboration and rapid shipping of cutting-edge AI capabilities.

$129,211–$178,250/yr
Canada

  • Lead the design and delivery of AI/ML systems, defining architecture and establishing engineering standards for agentic workflows.
  • Build and maintain RAG pipelines, agentic workflows, and production system prompts with eval and observability.
  • Mentor engineers and take end-to-end ownership of features, including debugging and hardening production systems.

Robots and Pencils designs AI systems for a human world, pairing engineering with creativity to ship production-ready AI in 30 to 45 days. They are a company where every role contributes directly to integrating AI into enterprise operations, with a culture that values ownership, craft, and measurable impact.

Global

  • Design agent architectures for planning, reasoning, tool use, and memory integration.
  • Improve reliability on long-running tasks with failure recovery and evaluation systems.
  • Build loops for agents to improve with real use, balancing quality, latency, and cost.

Adaption builds AI systems that evolve in real-time, making them flexible and personalized. They are a global-first team focused on talent density and collaboration.

$105,000–$147,000/yr
US

  • Build and ship features of AI/ML and LLM-powered systems with guidance from senior engineers.
  • Implement and maintain AI/ML and AI agent pipelines from data ingestion through model deployment.
  • Contribute to LLM-powered features such as prompts, evaluations, retrieval, and tool integrations, while documenting experiments clearly.

Robots & Pencils designs AI systems for a human world, pairing engineering with creativity. Teams average fifteen-plus years of experience and value ownership, craft, direct feedback, and continuous learning.

$160,000–$190,000/yr
US

  • Own end-to-end ML systems from data and training to evaluation, inference, and deployment.
  • Build and evolve training, fine-tuning, and inference infrastructure for large models.
  • Partner with research and application engineering to turn model capabilities into product improvements.

Next Step Systems is an IT recruiting and staffing agency that connects companies with machine learning and technology talent. They specialize in placing candidates in remote and on-site roles across the United States and emphasize a fast-paced, results-oriented culture.

France

  • Design, prototype, and build production-ready agentic workflows and LLM orchestration systems.
  • Move AI prototypes into scalable, low-latency microservices on Azure, ensuring production-grade integration.
  • Act as technical mentor for agent-focused engineering squads, driving AI quality and operational frameworks.

Shift Technology delivers AI agents that transform insurers' most critical work. With employees from over 50 countries, the company's culture is built on innovation, trust, and a drive to transform the insurance industry.

US

  • Design, deploy, and optimize large-scale ML systems for retrieval, ranking, and LLM-powered features.
  • Lead ML projects from concept to production, improving answer relevance and user experience.
  • Collaborate with Product, Data Science, and Engineering teams to shape technical direction.

The hiring partner is a technology company focused on building advanced AI systems that help users discover relevant answers from large collections of online conversations. It values innovation, collaboration, and responsible AI development, offering a remote work environment within the United States.

US

  • Build and ship LLM-powered applications and AI agent workflows.
  • Design systems for reasoning, planning, memory, tool use, and multi-step execution.
  • Optimize AI systems for quality, latency, and cost, and establish production practices for observability and evaluation.

Gina's Tech Jobs is a technology recruiting firm that connects companies with engineering and IT professionals. They focus on remote and onsite placements, offering personalized recruitment services and career support.

Global

  • Develop and deploy cutting-edge AI/ML solutions to enhance the platform and improve student learning experiences.
  • Design, develop, and optimize LLM-powered agentic systems and APIs for real product use cases.
  • Collaborate with senior engineers and contribute to evaluation frameworks and MLOps pipelines.

Interview Kickstart specializes in interview preparation and career transitions into high-demand tech fields like AI, ML, and Data Science. Over 17,000 tech professionals have been guided by current and former hiring managers to land coveted positions at companies like Google and Amazon.

India

  • Build RL environments, agentic systems, LLM pipelines, and evaluation frameworks for real-world AI use cases.
  • Develop benchmarks and evaluation harnesses to assess model quality across accuracy, safety, latency, and cost.
  • Conduct fine-tuning and model experiments, deploy self-hosted models, and document reproducible methodologies.

The employer is an organization focused on applied AI research, building practical and reusable AI systems for real-world use cases. It values curiosity, accountability, innovation, collaboration, and continuous learning in a remote environment.

India

  • Build reinforcement learning and agent environments for real customer and Frontier lab use cases, including task specifications, scoring, and evaluation.
  • Develop benchmarks and evaluation harnesses to measure model and data quality across accuracy, robustness, safety, latency, and cost.
  • Run fine-tuning, adapter, and other model experiments to evaluate how data and methods influence model behavior, and deploy local or self-hosted models for evaluation and inference.

Appen has been a leader in AI training data for over 30 years, specializing in human-generated data to train, fine-tune, and evaluate models across generative AI, LLMs, computer vision, and speech recognition. They support model development through an AI-assisted data annotation platform and a global crowd of over 1 million contributors in more than 200 countries, fostering a culture of innovation, collaboration, and humility over ego.

US

  • Evolve and run the agent platform for internal and client-facing use cases, including runtime, SDKs, templates, and paved paths.
  • Harden infrastructure with IaC, network topology, security controls, and operational tooling with SRE.
  • Design for regulated industry with PHI isolation, least-privilege identity, audit trails, and human review; own production SLOs and incident response.

Arcadia is a healthcare data platform that transforms complex, diverse data into a unified foundation to help organizations deliver better care, boost revenue, and lower costs. It is a remote-first team of fiercely driven individuals committed to making healthcare more sustainable, named a Built In 2026 Best Place to Work.

$159,100–$270,900/yr
US

  • Design, build, integrate, test, and operate platform services that support production AI agents across multiple product teams.
  • Implement reusable capabilities for orchestration, runtime execution, tool integrations, observability, reliability, and workflow automation.
  • Partner with product teams, platform teams, QA/Eval, operations, and support stakeholders to release agent capabilities with strong quality and operational readiness.

RealPage provides software solutions for the real estate industry, including property management and revenue management. The company emphasizes professional development and offers a comprehensive benefits package.

$2,500–$4,000/mo
US

  • Design, build, and maintain infrastructure for training, fine-tuning, and serving large language models.
  • Deploy and scale LLM inference services, manage GPU compute, and optimize workload scheduling and utilization.
  • Automate deployment workflows with infrastructure-as-code and CI/CD, and collaborate with ML engineers to move models to production.

Hire Hangar connects top talent with vetted employers and offers competitive pay and real growth opportunities. It focuses on matching remote contractors with fast-growing global companies.

$97,600–$139,000/yr
United States Canada

  • Build and maintain core infrastructure for Quora's ML platform, ensuring high availability, scalability, and performance.
  • Build and improve distributed systems serving ML models in production, from Large Recommendation Models to Large Language Models.
  • Work on GPU model serving, optimizing latency, throughput, and cost to support larger and more capable models.

Quora's mission is to grow the world's collective intelligence through two platforms: Quora for global knowledge sharing and Poe for AI agent collaboration. We are a remote-first company with passionate, collaborative, and high-performing global teams, rooted in transparency and experimentation.