Similar Jobs
See allML Systems Engineer, Inference
Runpod
Global
Python
VLLM
CUDA
Lead Inference Engineer
Aleroy
Global
LLM Inference
CUDA
Distributed Systems
Senior ML Engineer | Kimchi (Inference Stack Optimization)
Kimchi
Europe
Python
VLLM
PyTorch
Inference Engineer
Undisclosed
US
CUDA
Staff AI Platform Engineer
Code Metal
US
Python
Kubernetes
LLM Inference
Role Overview:
- The Inference Cloud team builds deployment and orchestration for d-Matrix's inference services.
- You will own end-to-end workload performance, matching bare metal standards.
What You Will Do:
- Diagnose performance issues across serving path and isolate root causes.
- Fix directly or hand off with evidence to owning teams.
- Build telemetry and playbooks to prevent recurring problems.
What You Will Bring:
- 8+ years performance/systems engineering with profiling expertise.
- Deep Linux, NUMA, Kubernetes, and LLM serving knowledge.
- Proficiency in Python and C/C++.
D-Matrix
d-Matrix is an AI infrastructure company that pioneered a memory-centric architecture for efficient AI inference. The culture values respect, collaboration, and direct communication, with humble experts driven by execution.