imdigitalashish / gpt-from-scratch

git clone https://github.com/imdigitalashish/gpt-from-scratch.git

A single executed notebook building and training a small GPT with RoPE and a phase-aware sparse MoE experiment