vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
vllm-project / vllm
Dao-AILab / flash-attention
Fast and memory-efficient exact attention
HKUSTDial / flash-sparse-attention
Trainable fast and memory-efficient sparse attention
FlashML-org / flashlib
Fast and memory-efficient classical machine learning operators
Saganaki22 / ComfyUI-sol-attn
NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14β1.44Γ vs SageAttention and β37% MLP peak VRAM on H3
yfyeung / PrunedCTC
Memory-efficient CTC loss with exact loss and first-order gradient equivalence under vocabulary reduction, and activation memory that no longer scales linearly with vocabulary size.
NVIDIA-BioNeMo / BioNeMo-Inference-Runtime
Easy, fast, and memory-efficient structure prediction inference
Newaiguy / ComfyUI-h3_sage_amd
AMD gfx12 (RX 9070/9070 XT) Memory-Efficient Sage Attention for MiniMax H3. Matches KJNodes' Nε‘ patch with native HIP kernel.