Source Job

$150,000–$160,000/yr

  • Lead engineers deploying, operating, and optimizing AI compute clusters at scale.
  • Oversee cluster reliability, GPU fleet operations, and incident response.
  • Coordinate with cross-functional teams to ensure cluster capabilities meet AI workloads.

Kubernetes Terraform Ansible Linux

20 jobs similar to Senior Manager, AI Infrastructure

Jobs ranked by similarity.

Europe

  • Lead the investigation and resolution of complex infrastructure, networking, and platform-related incidents.
  • Provide technical leadership for Kubernetes platform operations and supporting infrastructure services.
  • Mentor and support AI Infrastructure & Platform Operations Engineers, sharing technical knowledge through documentation and training.

Mirantis helps organizations ship code faster on public and private clouds, providing a public cloud experience on any infrastructure from the data center to the edge. The company serves many of the world's leading enterprises, including Adobe, DocuSign, Liberty Mutual, and PayPal, and is a leader in container management.

Canada

  • Build and maintain infrastructure platforms for over 200 backend services running on Kubernetes clusters with 40,000+ cores.
  • Lead and mentor other engineers, own complex infrastructure failures, and participate in a shared on-call rotation.
  • Drive cloud cost efficiency, estimate schedules, and use AI tools as a first-class collaborator in daily workflows.

Life360's mission is to keep people close to the ones they love through location sharing, safe driver reports, and crash detection. The company serves approximately 97.8 million monthly active users across more than 180 countries and has more than 500 remote-first employees.

Global Unlimited PTO

  • Lead and scale the Forward Deployed Engineering and Technical Support teams, defining engagement models and operating standards.
  • Own the FDE engagement lifecycle from technical discovery to deployment guidance, ensuring customer value.
  • Drive operational discipline across support tools and partner with Sales, Product, and Engineering on roadmap alignment.

Runpod is the AI Developer Cloud. More than one million developers use the platform to experiment, train, deploy, and scale AI, and we are a small, remote-first team that has processed over 20 billion inference requests and closed a $100M Series A.

Europe

  • Monitor, operate, and support production AI infrastructure platforms.
  • Investigate and resolve infrastructure, networking, hardware, and platform-related incidents.
  • Collaborate with engineering teams, hardware vendors, and datacenter personnel to resolve technical issues.

Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure infrastructure for AI and data-intensive applications. The company is growing and invests heavily in AI infrastructure and platform services.

Europe

  • Lead investigation and resolution of complex infrastructure, networking, and platform incidents.
  • Provide technical leadership for Kubernetes platform operations and drive automation initiatives.
  • Mentor engineers and develop operational standards, runbooks, and best practices.

Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. Serving enterprises like Adobe, PayPal, and Volkswagen, Mirantis is committed to open standards and freedom from lock-in.

US

  • Design and build the orchestration layer using Kubernetes, Slurm, or comparable technologies.
  • Build customer-facing platform APIs, CLIs, web portals, and SDKs.
  • Drive infrastructure-as-code, multi-tenant isolation, and platform reliability.

GPU One provides GPU-as-a-Service (GPUaaS), turning raw GPU infrastructure into a usable cloud platform. The company is building a multi-tenant orchestration layer to serve customers at scale, with a focus on platform engineering and AI infrastructure.

EMEA

  • Build and operate production-grade model serving infrastructure using vLLM, TGI, or Triton frameworks.
  • Design and implement auto-scaling, multi-model architectures, and intelligent request routing for ML inference.
  • Optimize GPU utilization, memory efficiency, and observability to ensure low-latency, cost-effective systems.

They are a distributed cloud infrastructure startup building AI-native cloud services with GPU-powered compute. The company is well-funded, fast-scaling, and operates in a remote-first environment with a focus on sustainability and decentralization.

US Unlimited PTO

  • Own and scale AI compute and deployment platforms including Kubernetes and GitOps pipelines.
  • Build inference infrastructure and observability stacks for LLM-powered workflows.
  • Drive security, compliance, and governance at the systems level in a regulated healthcare environment.

Hims & Hers is a leading health and wellness platform focused on making healthcare accessible and personal. As a publicly traded company on the NYSE (HIMS), it offers flexible/remote work and a culture centered on innovation and employee well-being.

Global

  • Develop, deploy, maintain, operate, and support an Agentic AI Developer Platform.
  • Strongly oriented towards technical implementation and operation of the platform with hands-on experience.
  • Collaborate and lend experience to less experienced team members as needed.

We build modern Machine Learning systems for demand planning and budget forecasting, offering custom AI solutions to optimize cloud-based systems. We are a remote startup with a culture that values being data nerds, open team players, ownership, and a positive mindset.

US

  • Develop and maintain core messaging, positioning, and value propositions for Mirantis’ AI infrastructure and cloud-native platform portfolio.
  • Translate technical capabilities like GPU orchestration and MLOps into compelling narratives for practitioners, platform engineers, and executives.
  • Produce high-quality technical content including solution briefs, white papers, blog posts, and enable sales teams with battlecards and objection-handling guides.

Mirantis is a Kubernetes-native AI infrastructure company that enables organizations to build scalable, secure, and sovereign infrastructure for AI and data-intensive workloads. The company fosters a culture of openness, collaboration, risk-taking, and continuous growth, working with passionate colleagues to help Fortune 500 customers implement next-generation cloud technologies.

EU

  • Design, build, and maintain platform infrastructure using IaC principles with tools like Terraform.
  • Develop memory services, vector storage patterns, and semantic search capabilities.
  • Operate a Kubernetes-based platform for the Data & AI department, enabling deployment and scaling via GitOps.

Redcare Pharmacy is Europe's No.1 e-pharmacy, striving to improve global health through innovation and collaboration. The company fosters a healthy, inclusive work environment where employees feel valued and inspired.

  • Optimize production LLM serving with vLLM and SGLang to maximize throughput and minimize latency through batching and quantization.
  • Profile training runs to find bottlenecks and resolve them with attention implementations like FlashAttention on H200 and GB200 hardware.
  • Deploy and operate multiple models on shared GPU clusters with autoscaling, bin-packing, and efficient handling of mixed workloads.

Egen is a fast-growing technology company with a data-first mindset, partnering with clients on Google Cloud and Salesforce to drive action through data and insights. We are a team of dedicated engineers who thrive on solving tough problems and continually innovate to achieve fast, effective results.

APAC

  • Operate and maintain large-scale Linux environments (bare metal, clusters, cloud) and monitor system health to ensure high availability.
  • Help scale clusters toward hundreds to thousands of nodes, improving performance, reliability, and resource utilization.
  • Automate operational tasks using Python, Bash, Ansible, or Terraform and contribute to system design and architecture decisions.

Mistral AI builds high-performance, open, and efficient AI systems to power next-generation applications. We are a collaborative, low-ego, and highly technical team operating across Europe, the US, and beyond, scaling rapidly to support thousands of nodes.

US

  • Serve as primary technical advisor to customers, leading discovery sessions and translating business priorities into AI-enabled solutions.
  • Lead cross-functional engineering teams to design and deploy secure, scalable, and high-performing AI software systems.
  • Mentor engineers, establish engineering standards, and drive delivery of enterprise-scale AI solutions.

LTS delivers AI-powered software solutions for complex business and mission challenges. The company values innovation, growth, collaboration, and quality, and offers a culture that rewards ambition and performance.

$175,000–$200,000/yr
US

  • Act as the primary NVIDIA AI Enterprise and vector database expert for HyperPOD customer environments, owning end-to-end triage across GPU, NVAIE services, and storage.
  • Author and maintain support triage runbooks, diagnostics bundles, and collaborate on observability dashboards for platform health and RAG metrics.
  • Build hands-on labs, PoCs, and reusable technical assets to accelerate support readiness and partner success.

DataDirect Networks (DDN) is a global market leader in AI and high-performance data storage, powering many of the world's most demanding AI data centers across industries like life sciences, healthcare, financial services, and research. They are a global company with strong innovation, customer-centricity, and a team of passionate professionals committed to shaping the future of AI and data management.

Global

  • Lead a high-leverage remote team of four infrastructure engineers, driving the evolution toward a scalable zero-toil platform.
  • Guide the team through an AI-driven engineering approach to reduce manual work and achieve zero-touch, scalable infrastructure.
  • Prepare and execute the strategy for CI/CD and artifact distribution systems to scale during a quality surge without increasing engineering toil.

Camunda is the enterprise platform for agentic orchestration, enabling organizations to coordinate AI agents, people, and systems across complex business processes. Trusted by over 700 organizations worldwide, including 9 of top 10 US banks, Camunda is a fully remote and global company with 150+ engineers across 20+ teams, and is transforming into an AI-first organization.

US Unlimited PTO

  • Lead end-to-end technical delivery for client-facing scientific and AI-driven projects.
  • Design, build, and deploy scalable software systems that extend or wrap scientific models.
  • Act as a technical liaison between researchers, product teams, and engineering stakeholders.

This role sits at the intersection of advanced AI systems, scientific computing, and real-world drug discovery applications, where engineering directly enables breakthroughs in life sciences. The position requires strong autonomy and the ability to operate in highly ambiguous, research-driven environments where experimentation and execution go hand in hand.

France Global

  • Lead a distributed team of Python engineers building infrastructure automation solutions for large-scale cloud and bare-metal environments.
  • Drive technical strategy, team growth, and engineering culture while contributing hands-on to codebases.
  • Collaborate with product, operations, and engineering stakeholders to align delivery with organizational goals.

Jobgether is an AI-powered job matching platform that connects candidates with hiring companies through objective and fair processes. It operates as a distributed remote team, fostering a culture of autonomy and high expectations.

US Unlimited PTO

  • Act as pre-sales technical lead for federal pursuits, leading discovery workshops and architecting AI security solutions in SaaS and airgapped environments.
  • Build mission-focused demonstrations and proof-of-concept AI applications, integrating SDKs and APIs to protect computer vision, LLM, and agentic workloads.
  • Advise customers on securing AI infrastructure aligned to MITRE ATLAS, OWASP Top 10 for LLMs, and NIST AI Risk Management Framework.

HiddenLayer protects the world’s most valuable technologies from adversarial AI attacks. Founded by AI professionals and security specialists, the company has been recognized with awards such as RSA Innovation Sandbox Winner and CB Insights AI 100, and has a venture-backed team focused on accelerating secure AI adoption.

$110,000–$120,000/yr

  • Own reliability, latency, and performance for AI platform services and data infrastructure on AWS.
  • Design and maintain CI/CD pipelines, infrastructure-as-code, and observability frameworks across the stack.
  • Partner with AI and data engineers to ensure secure, cost-optimized, and scalable deployment of platform components.

HHAeXchange is the leading technology platform for home and community-based care, providing an end-to-end homecare solution for people who are aging or have disabilities. Founded in 2008, the company is passionate about transforming healthcare by connecting patients, providers, managed care organizations, and states.