MiniCPM5: SOTA on-device LLMs, small yet powerful.
Albert: a small quadruped that learns to walk with PPO in MuJoCo and runs the policy on an ESP32
This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks
A single executed notebook building and training a small GPT with RoPE and a phase-aware sparse MoE experiment
A Chinese-language tutorial book that teaches LLM principles and walks through building and training a small LLaMA2-style model from scratch.