- Architect and maintain production high-traffic LLM serving systems.
- Optimize throughput, latency, and cost for leading open-source LLMs.
- Debug and optimize major inference engines like SGLang, vLLM, or TensorRT using PyTorch and CUDA.
NEAR AI
1 open remote positions
We are building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our team is focused on highly scalable and efficient infrastructure for open-source AI at a global scale, with a culture that values innovation and performance.