📈 GH Trending Explorer
Sponsored by Sorted Solution
Updated 2026-11-15 08:41 UTC 🎲 Surprise me

← all repos

zyhector / token-rush

git clone https://github.com/zyhector/token-rush.git

Single-stream LLM inference engine for Qwen3.8-27B on one RTX 5090 — int4 quantization + speculative decoding + custom Triton/CUDA kernels; 229–379 tok/s vs llama.cpp/SGLang/vLLM at batch size 1.

+0
stars, 24h · #78,612
+~0
stars, 7 days · #78,962
+~0
stars, 30 days · #77,819
25
★ total
5
forks · 1 open issues

Star history (as recorded here)

2026-11-10 · 25 ★ 2026-11-16 · 25 ★
LanguagePython
License—
Created2026-09-04 (2mo ago)
Last push2mo ago
OwnerUser

GitHub topics

Links

README

Loading README…