xlite-dev / Awesome-LLM-Inference
git clone https://github.com/xlite-dev/Awesome-LLM-Inference.git
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
+0
stars, 24h · #58,507
+~0
stars, 7 days · #58,581
+~0
stars, 30 days · #58,719
5.5k
★ total
441
forks · 7 open issues
Star history (as recorded here)
LanguagePython
LicenseGPL-3.0
Created2023-08-27 (3y ago)
Last push2d ago
OwnerOrganization
GitHub topics
awesome-llmdeepseekdeepseek-r1deepseek-v3flash-attentionflash-attention-3flash-mlallm-inferenceminimax-01mlapaged-attentionqwen3tensorrt-llmvllm