ScaleNav: Scalable Internet Video Pretraining for Language-Conditioned Local Navigation
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.
All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.
Official repository for "OpenWAM: An Open, Modular Exploration Towards Systematic World–Action Model Pretraining".
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
Efficient & Scalable Video Pretraining without the Heuristics
PyTorch Code for Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation
Pretraining Transformers Without Backpropagation
Speedrun for pretraining without backpropagation
Open-source code for training and scaling up energy-based foundation models.
HuRo: Robotizing Human Videos for Scalable VLA Pretraining (CoRL 2026)
—
The pretraining scaffold behind 'Pretraining a Mini Kimi K3' (free book): six-source HF data mix, benchmark decontamination, tokenizer, WSD training loop, run monitoring. 5B tokens for $252.
这是一套围绕 Stanford CS224N: Natural Language Processing with Deep Learning 整理的系统课程笔记。仓库以课程 19 节 Lecture 为主线,从 Word Vectors、RNN、Attention、Transformer 一路延伸到 Pretraining、Post-training、PEFT、RAG、Agents、Reasoning、Multilinguality、Interpretability 与 Multimodality。
Official implementation of SimpleTouch: tactile experts for contact-rich manipulation without tactile policy pretraining.