Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.
Implementing LLM architectures from scratch in PyTorch
π Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
A simple, performant, and scalable Jax LLM!
Sparse-upcycle a dense Gemma-3-270m into a Mixture-of-Experts (gemma3moe) and serve it on llama.cpp (CPU). Upcycle, train, inspect routing, GGUF.