vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
vllm-project / vllm
rasbt / LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
OpenImagingLab / FlashVSR_Plus
This is the official repo of FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching.
evanbaker315 / AttentionOS
Star the repo to help support! The open source operating system for creating viral content on social media.
rednote-machine-learning / RedKnot
Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
Tencent-Hunyuan / Prism
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
deepseek-ai / FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
PaddlePaddle / FlashMask
Efficient Mask-Aware Distributed Attention for Long-Context Training
FareedKhan-dev / kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
deepseek-ai / DeepSelect
DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers
NX-AI / KronLSTM
Flash-linear-attention compatible KronLSTM model and kernels by NXAI.
Dao-AILab / flash-attention
Fast and memory-efficient exact attention
xlite-dev / LeetCUDA
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
flashinfer-ai / flashinfer
FlashInfer: Kernel Library for LLM Serving
fla-org / flash-linear-attention
🚀 Efficient implementations for emerging model architectures
ruvnet / RuVector
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
uxlfoundation / oneDNN
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
alexgreensh / attention-span
Make your agents talk human. ADHD-friendly output styles for Claude Code, Codex, and others. So you can pay attention, not tokens.
pegainfer-project / pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
zechengtang / Spark-H3
Adaptive Block Sparse Attention for MiniMax-H3
lucidrains / PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
linto-ai / whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
OpenImagingLab / FlashVSR
[CVPR 2026] Towards Real-Time Diffusion-Based Streaming Video Super-Resolution — An efficient one-step diffusion framework for streaming VSR with locality-constrained sparse attention and a tiny conditional decoder.
mjun0812 / flash-attention-prebuild-wheels
Provide with pre-build flash-attention 2 and 3 package wheels on Linux and Windows using GitHub Actions
amitshekhariitbhu / llm-internals
Learn LLM internals step by step - from tokenization to attention to inference optimization.
NVIDIA / cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
QwenLM / FlashQLA
high-performance linear attention kernel library built on TileLang
inclusionAI / cuLA
CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.
amitshekhariitbhu / llm-inference-engineering
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
egma-ai / jev-code-reviewer
Review behavior, not just diffs. Jev prioritizes human attention; OpenAI explains the changes. Local CLI + agent skill + GitHub extension.
kyegomez / open-jev
an open-source, from-first-principles reconstruction of the ideas behind TypeSafe AI's Jev, written in pytorch
Intellindust-AI-Lab / GTR
GTR: Gated Token Recurrence for Efficient Dense Prediction
star7code / minimax-h3-chunk-star7
VRAM-efficient MiniMax H3 for ComfyUI: QKV/RoPE/MLP activation chunking, automatic OOM chunk reduction, and CK/SLA/Sol/Hybrid attention for SM75 and SM80+ GPUs.
Opselon / NexusTradingForexBot
👑 Enterprise-grade, high-frequency quantitative scalp trading engine for XAUUSD (Gold). Driven by PyTorch (TCN + Self-Attention), Smart Money Concepts (SMC/ICT) , Win32 C++ MT5 IPC bindings, and a real-time FastAPI Canvas Web Dashboard.
robinebers / attentionmachine-skills
Rob's skills to make you post every day without the hassle of editing. Turn raw recordings into finished Reels with the Claude or Codex you already have.
vdev-ctrl / Adaptive-Learnable-Hierarchical-Routing-
This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
DeepSeekV4Flash0731 / DeepSeek-V4-Flash-0731
DeepSeek V4 Flash 0731 - free deepseek v4 flash download, gguf, ollama, deepseek v4 pro 0813. deepseek v4 flash vs pro, benchmark, MoE, 1M context, compressed sparse attention, coding. CUDA/CPU, no API key, Windows local AI. Download:🡇
lucidrains / vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
BlinkDL / RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
lucidrains / x-transformers
A concise but complete full-attention transformer with a set of promising experimental features from various papers
xlite-dev / Awesome-LLM-Inference
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
km1994 / nlp_paper_study
该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记
google-research / scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
kyegomez / awesome-multi-agent-papers
A compilation of the best multi-agent papers
meta-pytorch / attention-gym
Helpful tools and examples for working with flex-attention
microsoft / MInference
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
lucidrains / perceiver-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
jmaczan / tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
melandlabs / openloomi
OpenLoomi is an open-source AI coworker. It connects your work tools, understands what you’re working on, and tells you what needs your attention, why it matters, and what to do next. It’s your open-source Attention Agent.
SandAI-org / MagiAttention
A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
structr / structr
ATTENTION: This repository is a clone of https://gitlab.structr.com/structr/structr. All development/issue tracking has moved there. | Structr is an integrated open-source low-code development and runtime environment that uses a graph database (Neo4j).
HKUSTDial / flash-sparse-attention
Trainable fast and memory-efficient sparse attention
kyegomez / zeta
Build high-performance AI models with modular building blocks
zengxiao-he / tessera
From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.
thu-ml / SLA
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
MuLabPKU / TransArch
Design hardware-friendly model architectures and migrate existing LLMs with minimal performance loss
vizart-vj / ComfyUI-MiniMax-H3-LongMedia
ComfyUI custom nodes for MiniMax H3 long-form video/audio generation with streamed Sol attention, compressed KV, adaptive VRAM guards, chunked MLP/final output, and SAFE long-sequence optimizations for limited VRAM.
Saganaki22 / ComfyUI-VDN-H3
Video Delta Net hybrid attention for MiniMax-H3 as a native ComfyUI node.
Nathanw1014 / strix-halo-llamacpp
Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.