Research Engineer, Pre-training

The Research Engineer will conduct research and implement solutions in areas such as model architecture, algorithms, data processing, and optimizer development. Responsibilities include independently leading small research projects while collaborating with team members on larger initiatives, designing, running, and analyzing scientific experiments to advance the understanding of large language models. Responsibilities also include optimizing and scaling training infrastructure to improve efficiency and reliability, developing and improving dev tooling to enhance team productivity, and contributing to the entire stack, from low-level optimizations to high-level model design. The ideal candidate will have an advanced degree in Computer Science, Machine Learning, or a related field, strong software engineering skills, and expertise in Python and deep learning frameworks.