Source Job

Global

  • Distributed pretraining: Implement and optimize model-parallel training on heterogeneous GPUs under low-bandwidth, high-latency links.
  • Performance optimization: Apply techniques that reduce communication overhead while maintaining model convergence in challenging network environments.
  • Elasticity and fault tolerance: Build robust checkpointing and recovery so runs survive node churn as participants join and leave.

PyTorch Distributed Training Python

4 jobs similar to Research Scientist

Jobs ranked by similarity.

Global

  • Build the RL post-training stack end-to-end: rollout ingestion, reward computation, policy updates, and returning updated weights to the network.
  • Invent algorithms for asynchronous, high-latency, partially trusted generation, including staleness tolerance and off-policy corrections.
  • Ship the first decentralized post-trained models, building evals and taking the release from run to public artifact.

Pluralis Research is developing Protocol Learning, a decentralized approach to training and serving large models on consumer devices. We are a small, deeply technical team backed by Union Square Ventures, with a remote-first culture and team members spread globally.

Global

  • Own the inference stack end-to-end, including pipeline-parallel execution, placement and routing, transport, serving engine, and failure handling.
  • Invent and validate novel algorithms for fast inference on consumer hardware over the public internet, then put them into production.
  • Serve both RL training rollouts and final model serving in a permissionless, trustless setting.

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. They are a world-class, deeply technical team backed by Union Square Ventures and other tier-1 investors.

Global 6w PTO 26w maternity 26w paternity

  • Design, run, and analyse large-scale RL post-training experiments such as RLHF and RL from verifiable rewards.
  • Research and develop methods that improve out-of-distribution generalization, including reward design, task diversity, and regularization.
  • Build held-out evaluations to measure generalization and catch reward hacking, and turn successful research into production training recipes.

Cohere is a leading security-first enterprise AI company building cutting-edge foundation models and end-to-end products for businesses. We are a global team of researchers, engineers, and designers passionate about their craft, headquartered in Toronto with offices worldwide.

$160,000–$190,000/yr
US

  • Own end-to-end ML systems from data and training to evaluation, inference, and deployment.
  • Build and evolve training, fine-tuning, and inference infrastructure for large models.
  • Partner with research and application engineering to turn model capabilities into product improvements.

Next Step Systems is an IT recruiting and staffing agency that connects companies with machine learning and technology talent. They specialize in placing candidates in remote and on-site roles across the United States and emphasize a fast-paced, results-oriented culture.