Pre-training Engineer
Benefits
7w PTO
Similar Jobs
See allResearch Scientist - Small Language Models
Fastino
Global
Deep Learning
Computer Vision
PyTorch
ML Engineer - Small Language Models
Fastino
Deep Learning
PyTorch
TensorFlow
Data Team Member
Poolside
Europe
Python
LLM
Prompt Engineering
Staff Research Engineer, Pre-training Data
US
Python
Spark
Rust
Senior AI/ML Specialist Solutions Architect
NVIDIA
US
Python
Terraform
Kubernetes
Your Mission:
- To make our training of the best foundational models for source code generation in the world faster.
Responsibilities:
- Profile large-scale training workloads and identify communication and computation bottlenecks
- Custom kernel development to improve training performance
- Collaborating with researchers to make novel research ideas scale efficiently
Skills & Experience:
- Understanding of Large Language Models (LLM)
- Knowledge of distributed training
- Strong CUDA background/experience with GPU programming
Poolside
Poolside aims to be the company that builds a world where AI powers economically valuable work and scientific progress. Their team is a multidisciplinary blend of research, engineering, and business experts distributed across Europe and North America, fostering a culture of collaboration and hard work.