Aleroy builds a unified platform for high-performance AI inference, enabling companies to deploy and run AI models at scale through a single API. We work in small, collaborative teams focused on solving complex engineering challenges in scalable AI infrastructure.
PTO Distribution
2 of 2 jobs
5w
Min
5w
25th
5w
Median
5w
75th
5w
Max
Benefits Overview
2 of 2 jobs
PTO
(2)
Health Insurance
(1)
Medical insurance
(1)
Performance Incentives
(1)
Own and improve the AI inference serving stack, including prefill/decode disaggregation, continuous batching, KV-cache management, and speculative decoding.
Drive GPU performance engineering by identifying and eliminating bottlenecks using CUDA, Triton, profiling, and kernel optimization.
Set the serving and measurement roadmap, establish engineering standards, and mentor engineers while remaining hands-on with implementation.