datawhalechina / diy-llm
git clone https://github.com/datawhalechina/diy-llm.git
V0.2 · 2mo ago
A Chinese-language course covering full-stack LLM construction, from tokenizers and Transformers to MoE, distributed training, scaling laws, inference, and alignment.
Why you might care
Built for Chinese-speaking learners, it adapts Stanford's CS336 with 6 progressive code assignments and domestic model examples like Qwen and DeepSeek. Prerequisites such as math and deep learning basics are filled in, and the course is organized as a readable online book.
+164
stars, 24h · #216
+~306
stars, 7 days · #745
+~1.3k
stars, 30 days · #650
1.7k
★ total · +22% this week
180
forks · 7 open issues
Star history (as recorded here)
LanguageJupyter Notebook
License—
Created2025-11-24 (11mo ago)
Last push14d ago
Watchers3
OwnerOrganization
GitHub topics
Links
- GitHub: github.com/datawhalechina/diy-llm
- Homepage: https://datawhalechina.github.io/diy-llm/
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.