Source Job

Global

  • Build and optimize RL infrastructure for large-scale training.
  • Improve efficiency across compute, memory, networking, and scheduling.
  • Design low-level optimizations, from kernels to runtime.

PyTorch Distributed Training CUDA Performance Optimization

20 jobs similar to Research Engineer - RL Infrastructure

Jobs ranked by similarity.

$150,000–$350,000/yr
Global

  • Build inference systems powering RL research, scaling toward 1–3T parameter models on NVL72 clusters.
  • Optimize rollout throughput, multi-node MoE inference, and weight-update overhead for long-horizon agents.
  • Collaborate with model researchers on architecture choices balancing model quality and execution cost.

Prime Intellect is building the open superintelligence stack, unifying compute, environments, and deployment for frontier-scale AI post-training. Backed by $150M in funding, the team is mission-driven and hard-working, focused on accelerating open AI research.

Global

  • Develop RL algorithms for reasoning, coding, and long-horizon tasks.
  • Design and run scaling experiments to improve training recipes across model sizes.
  • Extend RL training frameworks for asynchronous workflows and reliability.

Prime Intellect builds the open superintelligence stack, offering a platform that unifies compute, training, and deployment for frontier AI teams. With $150M in funding and a mission-driven culture, they focus on open-source AI research and real infrastructure.

$150,000–$350,000/yr
Global

  • Build and extend pretraining code to scale experiments into full training runs.
  • Evaluate model architecture changes and optimize training throughput and resilience.
  • Run controlled ablations and collaborate with data and evaluation researchers.

Prime Intellect is building an open superintelligence stack, providing the infrastructure and platform for frontier AI training and deployment. The company has raised $150M from top investors and boasts a mission-driven team working to decentralize AI.

Global

  • Distributed pretraining: Implement and optimize model-parallel training on heterogeneous GPUs under low-bandwidth, high-latency links.
  • Performance optimization: Apply techniques that reduce communication overhead while maintaining model convergence in challenging network environments.
  • Elasticity and fault tolerance: Build robust checkpointing and recovery so runs survive node churn as participants join and leave.

Pluralis Research is a decentralized AI research company developing Protocol Learning to train large models on consumer devices across the internet. The team is world-class and deeply technical, backed by tier-1 investors, with a remote-first culture.

ML Engineer

Noetik
Global Unlimited PTO

  • Design, build, and evolve systems for distributed model training and batch inference at scale.
  • Develop workflows for experiment tracking, model evaluation, and registry management.
  • Optimize training and inference performance across GPU utilization, data loading, and distributed communication.

NOETIK is a frontier therapeutics company using AI to understand human biology and improve oncology outcomes, building foundation models on proprietary multimodal data. It fosters a collaborative, interdisciplinary culture focused on solving hard problems together.

Global

  • Build the RL post-training stack end-to-end: rollout ingestion, reward computation, policy updates, and returning updated weights to the network.
  • Invent algorithms for asynchronous, high-latency, partially trusted generation, including staleness tolerance and off-policy corrections.
  • Ship the first decentralized post-trained models, building evals and taking the release from run to public artifact.

Pluralis Research is developing Protocol Learning, a decentralized approach to training and serving large models on consumer devices. We are a small, deeply technical team backed by Union Square Ventures, with a remote-first culture and team members spread globally.

$160,000–$190,000/yr
US

  • Own end-to-end ML systems from data and training to evaluation, inference, and deployment.
  • Build and evolve training, fine-tuning, and inference infrastructure for large models.
  • Partner with research and application engineering to turn model capabilities into product improvements.

Next Step Systems is an IT recruiting and staffing agency that connects companies with machine learning and technology talent. They specialize in placing candidates in remote and on-site roles across the United States and emphasize a fast-paced, results-oriented culture.

$200,000–$300,000/yr
US

  • Bring new open-source models into production with a focus on latency and throughput.
  • Optimize inference systems including batching, KV cache, speculative decoding, and quantization.
  • Design, deploy, and operate heterogeneous clusters across infrastructure vendors to improve reliability and cost efficiency.

They are an early-stage AI infrastructure startup making large language model inference faster and more cost-efficient. The small team focuses on low-level performance engineering and AI-assisted workflows, with a strong emphasis on technical fundamentals.

$150,000–$220,000/yr
Global Unlimited PTO

  • Lead the effort to make Runpod the fastest and most cost-efficient place for LLM inference, owning performance end to end.
  • Profile and diagnose performance bottlenecks across the serving stack, from scheduling to kernels, and implement fixes.
  • Work closely with product and infrastructure teams to shape how inference is offered, turning improvements into production-ready defaults.

Runpod is the AI Developer Cloud, providing a platform for over one million developers to experiment, train, fine-tune, deploy, and scale AI. We're a small, remote-first team that takes ownership seriously, moves fast, and has processed more than 20 billion inference requests.

Global

  • Own the inference stack end-to-end, including pipeline-parallel execution, placement and routing, transport, serving engine, and failure handling.
  • Invent and validate novel algorithms for fast inference on consumer hardware over the public internet, then put them into production.
  • Serve both RL training rollouts and final model serving in a permissionless, trustless setting.

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. They are a world-class, deeply technical team backed by Union Square Ventures and other tier-1 investors.

Global

  • Build the Learning Gym, a sandboxed environment for training and evaluating AI agents on real Niural workflows with ground-truth reward signals.
  • Engineer verifiers, run reinforcement learning loops, and establish honest baselines to prove agent improvements generalize.
  • Write first-author research papers and internal technical reports, and represent the work externally through preprints and talks.

Niural is a global payroll, Employer of Record (EOR), Agent of Record (AOR), and Contractor Management platform. It is a relentlessly ambitious team focused on building foundational internet infrastructure for the AI era.

Global

  • Design and build challenging evaluations and executable environments for coding and long-horizon agents.
  • Develop scoring logic and verifiers to detect reward hacks and trace failures through model outputs and harness code.
  • Build and scale RL data pipelines for generating and curating challenging coding and agentic tasks.

Prime Intellect is building the open superintelligence stack, providing infrastructure for post-training frontier AI models and open-source models trained for long-horizon tasks. The company has raised $150M from top investors and is a mission-driven team passionate about accelerating science and AI.

US

  • Lead the end-to-end machine learning lifecycle, from data preparation and model training to evaluation, inference, and deployment.
  • Build and optimize scalable training, fine-tuning, and inference pipelines for large-scale models on GPU infrastructure.
  • Establish production best practices for model quality, reliability, safety, and measurable performance improvements.

This company builds production-grade machine learning systems and large-scale GPU-powered inference pipelines. It is a fully remote team that values technical rigor, collaboration, and hands-on engineering.

$140,000–$180,000/yr
Global

  • Build and operate ML infrastructure and platforms powering AI products.
  • Design systems for model training, evaluation, deployment, inference, and experimentation.
  • Optimize model serving and inference infrastructure for high-throughput, low-latency workloads.

Global 6w PTO 26w maternity 26w paternity

  • Design, run, and analyse large-scale RL post-training experiments such as RLHF and RL from verifiable rewards.
  • Research and develop methods that improve out-of-distribution generalization, including reward design, task diversity, and regularization.
  • Build held-out evaluations to measure generalization and catch reward hacking, and turn successful research into production training recipes.

Cohere is a leading security-first enterprise AI company building cutting-edge foundation models and end-to-end products for businesses. We are a global team of researchers, engineers, and designers passionate about their craft, headquartered in Toronto with offices worldwide.

$225,000–$250,000/yr
US

  • Design and implement state-of-the-art ML models and training pipelines for robotics.
  • Develop efficient data/training strategies and evaluation frameworks for rapid experimentation.
  • Collaborate with engineering to optimize training infrastructure and deployment.

We're revolutionizing real-world automation by making robotic systems accessible to everyone. Our AI-powered platform brings software automation to physical spaces, and we're a small startup team working across the stack to solve customer problems.

US

  • Build, train, and evaluate machine learning models end to end, from data and experiment design through training and reporting.
  • Design reinforcement learning environments, reward functions, and verifiers, and fine-tune language models using methods like PPO, DPO, and GRPO.
  • Collaborate with domain experts, analyze datasets, and present findings clearly to both technical and non-technical audiences.

EnableComp provides specialty revenue cycle management solutions for healthcare organizations using its unified E360 RCM platform. It is a multi-year Top Workplaces recipient and has been named to the Inc. 5000 list of fastest-growing private companies for eleven years.

North America

  • Design and build systems that improve the efficiency of ML training and inference workloads.
  • Develop tooling and benchmarking frameworks to help ML engineers debug, profile, optimize, and monitor model performance.
  • Partner with ML teams to optimize distributed training, reduce costs, and drive technical strategy for scalability and reliability.

Reddit is a community of communities where users share interests and authentic conversations. With 100,000+ communities and ~130 million daily visitors, it has a flexible-first culture supporting remote work.

US

  • Design high-performance training platform components including orchestration, observability, and performance tuning.
  • Deliver end-to-end ML pipelines from dataset curation to training, validation, and deployment.
  • Drive technical direction across ML Platform, Infrastructure, Autonomy, and Safety teams.

Stack is developing revolutionary AI and advanced autonomous systems for safer, more reliable, and efficient operations, focusing on autonomous trucking. The Stack team brings decades of experience in real-world systems and is committed to a culture of inclusion, entrepreneurship, and innovation.

US Unlimited PTO

  • Build the component layer around our layout synthesis engine, including API contracts, services, and evaluation gates.
  • Turn model retraining into a one-command job with built-in benchmarks and readable results for the whole team.
  • Own latency and cost budgets for learned capabilities and partner with infrastructure engineers on MLOps and deployment.

Higharc is a VC-backed startup that is changing how new homes are designed and built using spatial AI and generative floor plan technology. The company is fully remote, has raised over $175M, and values flexibility, collaboration, and asynchronous deep work.