Source Job

  • Lead technical bring-up of large-scale GPU clusters from physical installation to validated production readiness.
  • Execute NVIDIA diagnostics, NCCL performance tests, and acceptance criteria for commercial service.
  • Serve as Tier 3 escalation point for complex production incidents and drive root cause analysis.

Linux Python Ansible Kubernetes

9 jobs similar to Principal AI Infrastructure Engineer

Jobs ranked by similarity.

  • Own and manage Tier 2 incidents and tickets for large-scale GPU compute and storage platforms.
  • Troubleshoot Linux servers, GPU systems, storage services, and Kubernetes/Slurm node failures.
  • Collaborate with NOC, SRE, and on-site technicians to restore service and improve runbooks.

Highrise AI is a GPU-native infrastructure platform built for modern AI workloads, providing scalable GPU compute across dedicated clusters, managed cloud, and confidential environments. As a subsidiary of Hut 8 Corp., it combines disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance.

$97,200–$113,400/yr
Global

  • Lead end-to-end technical deployments for GPU neocloud and AI Factory customers.
  • Configure and troubleshoot bare metal GPU infrastructure including CNI, GPU Operator, and storage.
  • Build playbooks and transfer knowledge to customer teams for self-sufficiency.

vCluster Labs provides a platform for AI infrastructure, helping GPU cloud providers and enterprises build Kubernetes-based clusters. They are a venture-backed startup with 40+ engineers and a remote-first culture, powering over 100,000 GPUs.

Europe

  • Own network solutioning for k0rdent AI, designing GPU cluster interconnects and multi-tenant isolation.
  • Publish reference architectures and run proofs of concept on real hardware with customers.
  • Research emerging AI networking technologies and help shape the product roadmap.

Mirantis is a Kubernetes-native AI infrastructure company helping organizations build and operate scalable, secure infrastructure for modern AI workloads. It is committed to open standards, technical excellence, and a distributed, collaborative team culture.

$135,000–$145,000/yr

  • Execute GPU node and cluster bring-up, validation, and automated testing across new hardware platforms.
  • Troubleshoot GPU and OS hardware/software issues, maintaining drivers, firmware, and system software.
  • Automate infrastructure with Python, Bash, and Ansible while monitoring cluster health and documenting processes.

Vultr provides high-performance cloud compute, GPU, bare metal, and storage solutions across 33 global data centers. It is a privately-held, employee-focused cloud infrastructure company valued at $3.5 billion with hundreds of thousands of customers.

$98,000–$150,000/yr
US

  • Own first response and resolution for issues across Kubernetes clusters, GitLab and CI runners, VMs, standalone systems, and demo environments.
  • Convert recurring issues into automation, alerts, and runbooks so repeat incidents decline.
  • Perform routine operational work, including upgrades, patching, certificate renewals, and capacity checks.

d-Matrix is focused on unleashing the potential of generative AI to power the transformation of technology. The culture is one of respect, collaboration, and humility, with an inclusive team that values direct communication and execution.

China

  • Operate and expand Telnyx's own B300 GPU fleet to maximize inference throughput per GPU-dollar.
  • Design and implement serverless inference for open-weight models and dedicated enterprise deployments.
  • Work upstream in open-source technologies like vLLM, SGLang, and Kubernetes.

Telnyx is an industry leader building the future of global connectivity through a private, multi-cloud IP network and edge APIs. The company is financially stable and profitable, with a global team and a focus on innovation and continuous learning.

Europe

  • Own the technical relationship and be the trusted advisor for CTOs and platform teams.
  • Architect real solutions that translate customer constraints into deployable AI infrastructure.
  • Lead proofs of concept under real conditions to demonstrate operational fit.

Mirantis is a Kubernetes-native AI infrastructure company that helps organizations build scalable and secure infrastructure for modern AI workloads. The company has an installed base of 1,500 enterprise customers and values open source innovation, collaboration, and continuous growth.

$200,000–$300,000/yr
US

  • Plan, configure, test, and roll out deployments across customer VPC and on-premises environments.
  • Partner with customer IT, security, and platform teams to resolve infrastructure issues.
  • Build monitoring, telemetry, and automation for scalable processes.

$184,000–$318,000/yr
US

  • Architect GPU cluster topologies spanning compute, networking, storage, and control planes.
  • Model AI workloads like LLM training and inference to guide performance tradeoffs.
  • Collaborate with cross-functional teams to deploy and scale reliable AI infrastructure.

This role is with a partner company focused on designing next-generation AI infrastructure at massive scale. The company fosters a fast-moving, engineering-led culture with a collaborative, international team.