Similar Jobs
See allStaff Forward Deployed Engineer
Tenstorrent
North America
Kubernetes
Helm
Python
Senior AI Infrastructure & Platform Operations Engineer
Mirantis
Europe
Linux
Kubernetes
Networking
Senior Software Engineer — Infra Agent Systems
Together AI
India
Go
Python
Kubernetes
AI Infrastructure & Platform Operations Engineer
Mirantis
Europe
Linux
Kubernetes
Networking
Senior Solutions Engineer
TensorWave
US
Kubernetes
GPU Infrastructure
Linux
What you'll do:
- Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
- Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
- Integrate the serving layer with the platform's API gateway, identity, and metering services.
What we're looking for:
- 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
- Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.
- Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.
Additional Information:
- Work with an established Silicon Valley leader in the cloud infrastructure industry.
- Be a part of cutting-edge, open-source innovation.
- Thrive in a high-energy environment with a young company where openness, collaboration, risk-taking, and continuous growth are valued.
Mirantis
Mirantis is a Kubernetes-native AI infrastructure company that helps organizations build and operate scalable infrastructure for AI and data-intensive applications. It is part of an IREN company and empowers platform engineering teams with open-source innovation and deep expertise in Kubernetes orchestration.