rasbt / reasoning-from-scratch

Implement a reasoning LLM in PyTorch from scratch, step by step

datawhalechina / diy-llm

Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐，6 项渐进代码作业，掌握 LLM 全栈知识

Isi-dev / Google-Colab_Notebooks

A Collection of Google Colab Notebooks for various projects

Prasannajaga / deployment-guide

Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).

Muennighoff / prefix-sliding

Prefix Sliding for efficient test-time scaling