Lead the effort to make Runpod the fastest and most cost-efficient place for LLM inference, owning performance end to end.
Profile and diagnose performance bottlenecks across the serving stack, from scheduling to kernels, and implement fixes.
Work closely with product and infrastructure teams to shape how inference is offered, turning improvements into production-ready defaults.
Runpod is the AI Developer Cloud, providing a platform for over one million developers to experiment, train, fine-tune, deploy, and scale AI. We're a small, remote-first team that takes ownership seriously, moves fast, and has processed more than 20 billion inference requests.
Bring new open-source models into production with a focus on latency and throughput.
Optimize inference systems including batching, KV cache, speculative decoding, and quantization.
Design, deploy, and operate heterogeneous clusters across infrastructure vendors to improve reliability and cost efficiency.
They are an early-stage AI infrastructure startup making large language model inference faster and more cost-efficient. The small team focuses on low-level performance engineering and AI-assisted workflows, with a strong emphasis on technical fundamentals.
Build inference systems powering RL research, scaling toward 1–3T parameter models on NVL72 clusters.
Optimize rollout throughput, multi-node MoE inference, and weight-update overhead for long-horizon agents.
Collaborate with model researchers on architecture choices balancing model quality and execution cost.
Prime Intellect is building the open superintelligence stack, unifying compute, environments, and deployment for frontier-scale AI post-training. Backed by $150M in funding, the team is mission-driven and hard-working, focused on accelerating open AI research.
Design, build, and evolve systems for distributed model training and batch inference at scale.
Develop workflows for experiment tracking, model evaluation, and registry management.
Optimize training and inference performance across GPU utilization, data loading, and distributed communication.
NOETIK is a frontier therapeutics company using AI to understand human biology and improve oncology outcomes, building foundation models on proprietary multimodal data. It fosters a collaborative, interdisciplinary culture focused on solving hard problems together.
Own the inference stack end-to-end, including pipeline-parallel execution, placement and routing, transport, serving engine, and failure handling.
Invent and validate novel algorithms for fast inference on consumer hardware over the public internet, then put them into production.
Serve both RL training rollouts and final model serving in a permissionless, trustless setting.
Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. They are a world-class, deeply technical team backed by Union Square Ventures and other tier-1 investors.
Owns the architectural direction for Code Metal's AI platform and the team building it.
Builds production-grade inference serving, model gateways, agent harnesses, and context-engineering services.
Instruments the stack end to end and drives experimentation and observability for reliable AI systems.
Code Metal provides automated software engineering using AI and formal verification to produce provably correct code. Founded in 2023 and backed by Accel, Salesforce Ventures, and others, it serves defense and enterprise customers from offices in Boston and San Francisco.
Design, build, and maintain infrastructure for training, fine-tuning, and serving large language models.
Deploy and scale LLM inference services, manage GPU compute, and optimize workload scheduling and utilization.
Automate deployment workflows with infrastructure-as-code and CI/CD, and collaborate with ML engineers to move models to production.
Hire Hangar connects top talent with vetted employers and offers competitive pay and real growth opportunities. It focuses on matching remote contractors with fast-growing global companies.
Own end-to-end ML systems from data and training to evaluation, inference, and deployment.
Build and evolve training, fine-tuning, and inference infrastructure for large models.
Partner with research and application engineering to turn model capabilities into product improvements.
Next Step Systems is an IT recruiting and staffing agency that connects companies with machine learning and technology talent. They specialize in placing candidates in remote and on-site roles across the United States and emphasize a fast-paced, results-oriented culture.
Build the component layer around our layout synthesis engine, including API contracts, services, and evaluation gates.
Turn model retraining into a one-command job with built-in benchmarks and readable results for the whole team.
Own latency and cost budgets for learned capabilities and partner with infrastructure engineers on MLOps and deployment.
Higharc is a VC-backed startup that is changing how new homes are designed and built using spatial AI and generative floor plan technology. The company is fully remote, has raised over $175M, and values flexibility, collaboration, and asynchronous deep work.
Design high-performance training platform components including orchestration, observability, and performance tuning.
Deliver end-to-end ML pipelines from dataset curation to training, validation, and deployment.
Drive technical direction across ML Platform, Infrastructure, Autonomy, and Safety teams.
Stack is developing revolutionary AI and advanced autonomous systems for safer, more reliable, and efficient operations, focusing on autonomous trucking. The Stack team brings decades of experience in real-world systems and is committed to a culture of inclusion, entrepreneurship, and innovation.
Own the client's GKE-based H200/GB200 training platform from the workload side, tuning GPU scheduling and networking.
Run, scale, and debug multi-node distributed training with PyTorch (FSDP, DeepSpeed, Megatron/NeMo-style) and Ray Train.
Design benchmarks, evals, and telemetry so platform and training changes are measured, not assumed.
Egen is a data-first engineering company that helps clients drive action and impact through data and insights using advanced platforms like Google Cloud and Salesforce. It is a fast-growing, entrepreneurial workplace focused on learning, solving tough problems, and continual innovation.