πŸ“ˆ GH Trending Explorer 🎲 Surprise me

Search: attention-mechanism Β· clear

rasbt / LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

β–² ~387/7d β˜… 107k Jupyter Notebook 21d ago
ruvnet / RuVector

RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.

β–² ~30/7d β˜… 4.6k Rust today
BlinkDL / RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

β–² ~5/7d β˜… 15k Python 25d ago
lucidrains / PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

β–² ~5/7d β˜… 7.9k Python 1mo ago
AhmadJeddi / Plant-Disease-Classification

A ResNet50-DCBAM deep learning framework for plant disease classification using the PlantVillage dataset with reproducible training and evaluation pipelines.

β–² ~2/7d β˜… 48 Python 4d ago
lucidrains / vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

β–² ~0/7d β˜… 26k Python 10d ago
lucidrains / x-transformers

A concise but complete full-attention transformer with a set of promising experimental features from various papers

β–² ~0/7d β˜… 6.0k Python 7d ago
kyegomez / zeta

Build high-performance AI models with modular building blocks

β–² ~0/7d β˜… 604 Python 4d ago
lucidrains / learn-attention

Sharing how attention appears in my mind's eye, for students and those interested in understanding transformers

β–² ~0/7d β˜… 60 HTML 3d ago
FemtoRhythm / pyramis-l3d

Pyramis-L3D: hierarchical sparse attention research prototype (code only; weights on Hugging Face)