A free, MIT-licensed course of 542 lessons on AI engineering, implementing model internals, retrieval, and agent runtimes from scratch.
🧠 Train a 64M-parameter LLM from scratch in just 2h!
Implementing LLM architectures from scratch in PyTorch
A straightforward method for training your LLM, from downloading data to generating text.
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
👋 Hello Agent System — learn enterprise AI agent system design by building every production layer from scratch. 17 bilingual lessons (EN/中文) with tested exercises: tools, architectures, reliability, security, evals, distributed execution, cost, RAG, release ops. 企业级 Agent 系统设计训练营
Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南
👀 Train a 65M-parameter VLM from scratch in just 2h!
🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
Learn AI agents from scratch.
Learn harness engineering by building Claude Code from scratch. Free, open-source course: 8 articles, 6 videos, 1 codebase.
Kill the tool-call tax: harness tool latency back below model TPS. Fast local lanes, persistent pools, session caches. Scratch lab turned real.
LLM building from scratch
Master the fundamentals of machine learning, deep learning, and mathematical optimization by building key concepts and models from scratch using Python.
哈喽!龙虾 🙋♀️ Adopt from scratch and build your first claw 🦞 来领养你的第一只龙虾!
Docker build for FFmpeg on Ubuntu / Alpine / Centos / Scratch / nvidia / vaapi
Continual learning model trained from scratch on 8GB VRAM laptop with batch-1 stream of data.
Can Language Models Rebuild Programs From Scratch?
Scratchpads & many goodies for Hyprland & others [maintainer=@fdev31]
Building Convolutional Neural Networks From Scratch using NumPy
From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.
AI-powered post-writing toolkit for academic papers — format validation, grammar/style polishing, de-AI editing, reference checking, and reviewer-style paper audits. 5 skills for LaTeX, Typst & PDF. Focused on enhancing existing text quality, not generating from scratch.
[Tech Report] Democratizing the Training of Video World Models from Scratch. 🔥 🔥 🔥
PyTorch 기반 한국어 LLM 구현 및 학습 프로젝트
A compiler for a small C-like language, written from scratch in Python: table-driven DFA scanner, transition-diagram predictive parser generated from a plain-text grammar with FIRST/FOLLOW sets, semantic analysis and three-address code generation onto a 12-instruction stack VM.
从 0 训练大模型,单卡训练一个 200M 参数模型的全流程(train a 200M‑parameter model from scratch)
面向面试的Stanford CS336: Language Modeling from Scratch
Learn DeepSeek Harness from scratch.
A lightweight coding agent 🧑💻 built from scratch, with tool calling, session persistence, workspace context, memory, and multi-provider LLM support 🛠️.
A Super Mario 64 demake built in Scratch
Independent from-scratch implementation of the Kimi K3 architecture (arXiv:2607.24653v1): KDA, NoPE, latent-space MoE, and the systems co-designs. Table 1 reproduced to 0.09%.
Neural network from scratch in pure Python + NumPy that recognises handwritten digits (MNIST), with an educational GUI: watch it learn, tweak it while it trains, look inside every layer.
A modern 124M-parameter decoder-only LLM built from scratch. RoPE · RMSNorm · SwiGLU · GQA · KV Cache · BPE Tokenizer · Full training pipeline. Research-grade, production-quality.
Code repository for World Model From Scratch book
从零手写一个 AI Agent 的教学型 Python 项目:不依赖任何智能体框架实现核心循环,用约 3700 行可通读的代码,把 Agent 拆成乐高积木式的基础部件——模型调用、工具协议、执行上下文、记忆、RAG、Skills、E2B 沙箱与多智能体编排,逐层拼装、每一步都能追到源码。附 20 个可运行示例、21 章系统课程与 30 篇分层文档,配有单元与集成测试、mypy 严格类型检查。学操作系统要写迷你 OS,学数据库要写迷你数据库,学 Agent 就该亲手写一个:先建知识底座,再上生产框架。适合初学者、大学生与用过框架想补原理的工程师。MIT 开源,Python 3.13。
An ultra-lightweight, zero-bloat bare-metal operating system built from scratch for a custom RISC-V (RV32I) simulation layer. Featuring preemptive multitasking, page frame allocation, a custom toolchain, and an interactive shell.
Build world models from scratch — from perception and latent dynamics to planning, JEPA, VLA, and 3D/4D intelligence.
Data World: Scaling Data Environments from Scratch
🎙️ A 0.1B Omni model trained from scratch, capable of listening, speaking, and seeing!
setup guide for deepseek-flash-0731 on two dgx-spark from scratch
Build an AI Coding Agent from Scratch in Pure Python, Step by Step | 用纯 Python 从零搭建 AI 编程 Agent,边实现边理解其工作原理