Implementation of Denoising Diffusion Probabilistic Model in Pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
A concise but complete full-attention transformer with a set of promising experimental features from various papers
Vector (and Scalar) Quantization, in Pytorch
Build high-performance AI models with modular building blocks
Implementation of Οβ, the robotic foundation model architecture proposed by Physical Intelligence
Implementation of RoboTTT proposed by Yunfan Jiang et al. of Stanford and Nvidia
Implementation of Light Loco Parkour, Versatile Perceptive Whole-Body Locomotion via Multi-Skill Distillation, out of Light Origins Labs
Implementation of the recurrent looped transformer proposed by Yifan Zhang of Princeton
Sharing how attention appears in my mind's eye, for students and those interested in understanding transformers
Implementation of BDH-CQ: In-Context Learning with Recurrent Latent Reasoning, proposed by Pathway Research