Similar Jobs
See allLead Machine Learning Engineer, Inference & Performance
Egen
Python
Kubernetes
Senior Software Engineer, Machine Learning Inference Platform
Stack AV
US
C++
Python
PyTorch
AI Infrastructure Engineer
Pragmatike
EMEA
Python
Kubernetes
Terraform
Research Engineer, AI Models
EnCharge AI
India
Python
PyTorch
Fine-tuning
Staff MLOps Engineer
Sequen
US
Python
PyTorch
Docker
About The Role:
- We are seeking an expert in high-performance LLM serving systems and inference optimization.
- You will push the boundaries of how large language models are served.
What You'll Be Doing:
- Architect and maintain production high-traffic LLM serving systems.
- Optimize throughput, latency, and cost for leading open-source LLMs.
What We're Looking For:
- Strong hands-on experience in LLM inference with major inference engines like SGLang, vLLM, or TensorRT.
- Deep knowledge of GPU architectures and effective exploitation using PyTorch, Triton, CuTe, CUDA.
- Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems.
NEAR AI
We are building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our team is focused on highly scalable and efficient infrastructure for open-source AI at a global scale, with a culture that values innovation and performance.