rasbt / LLMs-from-scratch

git clone https://github.com/rasbt/LLMs-from-scratch.git

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

107k

★ total

16k

forks · 4 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguageJupyter Notebook

License—

Created2023-07-23 (3y ago)

Last push18d ago

OwnerUser

GitHub topics

ai artificial-intelligence attention-mechanism deep-learning finetuning from-scratch generative-ai gpt instruction-tuning language-model large-language-models llm machine-learning natural-language-processing pretraining python pytorch tokenizer transformers

Links

GitHub: github.com/rasbt/LLMs-from-scratch
Homepage: https://amzn.to/4fqvn0D
Releases · Issues · Hacker News mentions