Own and improve the AI inference serving stack, including prefill/decode disaggregation, continuous batching, KV-cache management, and speculative decoding.
Drive GPU performance engineering by identifying and eliminating bottlenecks using CUDA, Triton, profiling, and kernel optimization.
Set the serving and measurement roadmap, establish engineering standards, and mentor engineers while remaining hands-on with implementation.
Aleroy builds a unified platform for high-performance AI inference, enabling companies to deploy and run AI models at scale through a single API. We work in small, collaborative teams focused on solving complex engineering challenges in scalable AI infrastructure.
Evaluate GPU kernel tasks for technical accuracy, realism, and reproducibility.
Identify memory allocation bugs, execution bottlenecks, and errors in parallel computing logic.
Provide clear, actionable feedback to improve AI training and evaluation workflows.
A partner company operating a specialized AI training project to improve the technical accuracy of AI systems. The company seeks experienced technical professionals for freelance, remote evaluation work, emphasizing precision and evidence-based assessment.
Own end-to-end performance optimization for production ML workloads, from bottleneck identification to rollout.
Diagnose ML performance bottlenecks across model execution, frameworks, runtimes, memory, and CPU/GPU utilization.
Design and implement improvements in inference execution, runtime behavior, batching, memory management, and precision.
Reddit is a community of communities, hosting open and authentic conversations across the internet. With over 100,000 active communities and approximately 130 million daily active users, it is one of the web's largest sources of information.
Build the platform and agent harness that decides how each model runs across AIPU, CPU, and accelerators.
Own model ingestion from PyTorch/ONNX and implement heterogeneous execution with offloading and caching.
Drive end-to-end performance by profiling host/device time and data movement, validating each speedup.
Axelera AI builds the next-generation AI platform, with Metis delivering 3-5x efficiency gains to support human advancement. With $450M raised and 250+ employees (60+ PhDs), it offers an open, innovative, inclusive culture spanning 21 countries.
Develop and optimize high-performance C++ features in an existing real-time engine.
Profile and tune CPU/GPU performance, memory use, and frame times on target platforms.
Support porting to new platforms and graphics APIs, writing shaders as needed.
Software Mind develops impactful solutions for companies globally. With a culture of openness, respect, and grit, they combine employment with enjoyment across cross-functional engineering teams.