Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
Learn LLM internals step by step - from tokenization to attention to inference optimization.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
A ResNet50-DCBAM deep learning framework for plant disease classification using the PlantVillage dataset with reproducible training and evaluation pipelines.
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
A concise but complete full-attention transformer with a set of promising experimental features from various papers
Build high-performance AI models with modular building blocks
Video Delta Net hybrid attention for MiniMax-H3 as a native ComfyUI node.
Sharing how attention appears in my mind's eye, for students and those interested in understanding transformers
Pyramis-L3D: hierarchical sparse attention research prototype (code only; weights on Hugging Face)