MiniCPM5: SOTA on-device LLMs, small yet powerful.
Albert: a small quadruped that learns to walk with PPO in MuJoCo and runs the policy on an ESP32
This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks
A single executed notebook building and training a small GPT with RoPE and a phase-aware sparse MoE experiment
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API