EricLBuehler / candle-vllm
git clone https://github.com/EricLBuehler/candle-vllm.git
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
+1
stars, 24h · #18,226
+~2
stars, 7 days · #27,367
+~10
stars, 30 days · #30,932
736
★ total · +0% this week
92
forks · 30 open issues
Star history (as recorded here)
LanguageRust
LicenseMIT
Created2023-10-29 (2y ago)
Last push5d ago
OwnerUser