Source Job

Global 5w PTO

  • Define the technical direction and architecture for a rapidly expanding GPU cluster platform.
  • Lead and mentor a team of senior infrastructure engineers while staying hands-on with complex systems.
  • Establish security strategies and operational practices to ensure reliable, efficient AI experiments.

Kubernetes Linux Python Terraform

20 jobs similar to Tech Lead Manager, GPU Cluster Infrastructure

Jobs ranked by similarity.

  • Lead technical bring-up of large-scale GPU clusters from physical installation to validated production readiness.
  • Execute NVIDIA diagnostics, NCCL performance tests, and acceptance criteria for commercial service.
  • Serve as Tier 3 escalation point for complex production incidents and drive root cause analysis.

Highrise AI is a GPU-native infrastructure platform providing scalable compute for AI workloads across dedicated clusters and managed cloud. As a subsidiary of Hut 8 Corp, it combines disciplined operations, automation, and on-site engineering to sustain high uptime and predictable performance.

  • Lead deployment and configuration of x86 servers, Linux, virtualization, and core infrastructure services for AI clusters.
  • Optimize high-performance storage platforms like WEKA and VAST, and validate performance, resilience, and integration.
  • Provide Tier 3 escalation and automate provisioning, identity, and infrastructure-as-code using Ansible, Terraform, and Python.

Highrise AI is a GPU-native infrastructure platform delivering scalable compute for modern AI workloads across dedicated clusters, managed cloud, and confidential environments. As a subsidiary of Hut 8 Corp., it operates next-generation GPU clusters with disciplined operations and a growing global team of engineers and builders.

$97,200–$113,400/yr
Global

  • Lead end-to-end technical deployments for GPU neocloud and AI Factory customers.
  • Configure and troubleshoot bare metal GPU infrastructure including CNI, GPU Operator, and storage.
  • Build playbooks and transfer knowledge to customer teams for self-sufficiency.

vCluster Labs provides a platform for AI infrastructure, helping GPU cloud providers and enterprises build Kubernetes-based clusters. They are a venture-backed startup with 40+ engineers and a remote-first culture, powering over 100,000 GPUs.

$200,000–$300,000/yr
US

  • Plan, configure, test, and roll out deployments across customer VPC and on-premises environments.
  • Partner with customer IT, security, and platform teams to resolve infrastructure issues.
  • Build monitoring, telemetry, and automation for scalable processes.

  • Own and manage Tier 2 incidents and tickets for large-scale GPU compute and storage platforms.
  • Troubleshoot Linux servers, GPU systems, storage services, and Kubernetes/Slurm node failures.
  • Collaborate with NOC, SRE, and on-site technicians to restore service and improve runbooks.

Highrise AI is a GPU-native infrastructure platform built for modern AI workloads, providing scalable GPU compute across dedicated clusters, managed cloud, and confidential environments. As a subsidiary of Hut 8 Corp., it combines disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance.

UK

  • Manage and optimize Kubernetes clusters in GKE through Terraform.
  • Design and implement golden paths and automation strategies that empower developers to self-serve.
  • Serve as the technical point-of-contact for GCP and Kubernetes queries, supporting compliance and internal teams.

Prolific is the architect of human data infrastructure, connecting researchers and companies with a global pool of participants to collect high-quality, ethically sourced behavioral data for AI development. They are a mission-driven, remote-first company at the forefront of AI innovation.

Europe

  • Own the technical relationship and be the trusted advisor for CTOs and platform teams.
  • Architect real solutions that translate customer constraints into deployable AI infrastructure.
  • Lead proofs of concept under real conditions to demonstrate operational fit.

Mirantis is a Kubernetes-native AI infrastructure company that helps organizations build scalable and secure infrastructure for modern AI workloads. The company has an installed base of 1,500 enterprise customers and values open source innovation, collaboration, and continuous growth.

Europe

  • Own network solutioning for k0rdent AI, designing GPU cluster interconnects and multi-tenant isolation.
  • Publish reference architectures and run proofs of concept on real hardware with customers.
  • Research emerging AI networking technologies and help shape the product roadmap.

Mirantis is a Kubernetes-native AI infrastructure company helping organizations build and operate scalable, secure infrastructure for modern AI workloads. It is committed to open standards, technical excellence, and a distributed, collaborative team culture.

US

  • Lead the strategic direction, engineering, and operational management of enterprise cloud and infrastructure platforms.
  • Own the cloud operating model, including service catalog, SLAs/SLOs, governance, and cost optimization.
  • Build and develop a team of cloud platform engineers, SREs, and security engineers, driving reliability and automation.

Banner Health is one of the largest nonprofit health care systems in the country, delivering hospital services and advanced technology. They offer a comprehensive benefits package and a culture centered on making health care easier for every employee.

US

  • Own ScaleOps' infrastructure end-to-end, including self-hosted product, SaaS platform, and AI infrastructure.
  • Manage cloud infrastructure across AWS, GCP, and Azure, covering networking, security, SSO, and compute.
  • Collaborate with customers and internal teams to ensure reliable feature delivery and eliminate operational toil.

ScaleOps is redefining autonomous cloud and AI infrastructure, freeing DevOps and platform engineers from manual resource management. We are the category leader backed by over $210M in funding, trusted by leading enterprises including Adobe, Coinbase, and Fortune 100 companies.

GPU Engineer

Vultr
$135,000–$145,000/yr

  • Execute GPU node and cluster bring-up, validation, and automated testing across new hardware platforms.
  • Troubleshoot GPU and OS hardware/software issues, maintaining drivers, firmware, and system software.
  • Automate infrastructure with Python, Bash, and Ansible while monitoring cluster health and documenting processes.

Vultr provides high-performance cloud compute, GPU, bare metal, and storage solutions across 33 global data centers. It is a privately-held, employee-focused cloud infrastructure company valued at $3.5 billion with hundreds of thousands of customers.

US

  • Own security solutioning for k0rdent AI across the full stack, from hardware to AI models.
  • Publish reference architectures and proofs of concept with customers and partners.
  • Research emerging threats and present to engineers, executives, and conference audiences.

Mirantis, an IREN company, is the Kubernetes-native AI infrastructure company enabling organizations to build scalable, secure infrastructure for AI and data-intensive applications. It is a distributed, world-class team committed to openness and technical excellence.

North America

  • Design, build, and operate production Kubernetes platforms, owning cluster architecture, networking, reliability, and security.
  • Troubleshoot complex infrastructure issues across Kubernetes, Linux, networking, and cloud environments, and improve observability and automation.
  • Take ownership of critical infrastructure initiatives, incident response, and mentorship while working autonomously in a remote-first environment.

Our partner is a technology company building and operating large-scale Kubernetes platforms and complex production infrastructure. It is a remote-first organization with a focus on autonomy, technical ownership, and collaboration across North America and Latin America.

$135,000–$150,000/yr
US

  • Operate, scale, and troubleshoot Bitsight's SaaS cloud infrastructure with focus on reliability, efficiency, and security.
  • Tackle complex system-level designs and proactively anticipate performance and scalability issues.
  • Pioneer self-optimizing infrastructure systems using AI, ensuring manual and staging validation before production deployment.

Bitsight is a cyber risk management leader transforming how companies manage exposure, performance, and risk. Over 3,500 customers and 600 teammates work across Boston, Raleigh, New York, Lisbon, Singapore, and remote locations.

$190,000–$230,000/yr
US

  • Design and implement scalable cloud infrastructure using Kubernetes, Pub/Sub, and distributed systems technologies.
  • Collaborate with our AI team to optimize data pipelines and integrate AI to remove performance bottlenecks.
  • Drive platform reliability initiatives including alerting, health checking, and incident management.

Syllo is building a unified litigation platform that helps lawyers and paralegals use AI throughout the litigation life cycle. We are a quickly expanding company with enterprise customers including major law firms and corporations.

Global

  • Design, configure, and optimize Kubernetes clusters to support large-scale P2P experiments and benchmarks.
  • Automate infrastructure and deployment workflows, improving scalability, reliability, and observability.
  • Collaborate with DST researchers to troubleshoot, profile, and tune distributed systems for accurate performance insights.

Logos (λ) is a movement building a sovereign, people-owned technology stack to revitalise civil society and protect digital liberties. The Distributed Systems Testing team within IFT Technical Services supports Logos and other IFT projects with a collaborative, open-source culture.

$180,000–$220,000/yr
US

  • Design, implement, and maintain reliable, scalable, and secure infrastructure to support applications and automation systems.
  • Automate infrastructure provisioning, configuration management, and deployment pipelines using tools like Terraform and ArgoCD.
  • Implement observability solutions and enforce security best practices to ensure uptime and system performance.

Bright Machines is a next-generation, AI-enabled manufacturer focused on data center infrastructure production, using proprietary AI-based robotics and software to assemble hardware products for hyperscalers and OEMs. The company is headquartered in San Francisco, California, with an integration center in Guadalajara, Mexico, and has been recognized by Forbes' AI 50 and other leading organizations.

US Unlimited PTO

  • Owns the architectural direction for Code Metal's AI platform and the team building it.
  • Builds production-grade inference serving, model gateways, agent harnesses, and context-engineering services.
  • Instruments the stack end to end and drives experimentation and observability for reliable AI systems.

Code Metal provides automated software engineering using AI and formal verification to produce provably correct code. Founded in 2023 and backed by Accel, Salesforce Ventures, and others, it serves defense and enterprise customers from offices in Boston and San Francisco.

$98,000–$150,000/yr
US

  • Own first response and resolution for issues across Kubernetes clusters, GitLab and CI runners, VMs, standalone systems, and demo environments.
  • Convert recurring issues into automation, alerts, and runbooks so repeat incidents decline.
  • Perform routine operational work, including upgrades, patching, certificate renewals, and capacity checks.

d-Matrix is focused on unleashing the potential of generative AI to power the transformation of technology. The culture is one of respect, collaboration, and humility, with an inclusive team that values direct communication and execution.

$184,000–$318,000/yr
US

  • Architect GPU cluster topologies spanning compute, networking, storage, and control planes.
  • Model AI workloads like LLM training and inference to guide performance tradeoffs.
  • Collaborate with cross-functional teams to deploy and scale reliable AI infrastructure.

This role is with a partner company focused on designing next-generation AI infrastructure at massive scale. The company fosters a fast-moving, engineering-led culture with a collaborative, international team.