ML Infra Engineer

You would be working in our pre-training team focused on building out our distributed training and inference of Large Language Models (LLMs). This is a hands-on role that focuses on software development best practices, maintenance, and code architecture. You will have access to thousands of GPUs to verify changes.

To help train the best foundational models for source code generation in the world.

Propose and evaluate innovations in the training development experience and reliability. Enhance and maintain our training and inference codebases. Write high-quality Python (PyTorch), Cython, C/C++ code and perform refactorings. Improve CI/CD.