hyukudan / strix-halo-engine-lab
git clone https://github.com/hyukudan/strix-halo-engine-lab.git
Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; DeepSeek V4.1 Flash across two nodes over USB4 with an optional RTX PRO. Speculative decoding bit-identical to greedy, up to 255 tok/s on coding chat. MiniMax and GLM next.
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
31
★ total
5
forks · 43 open issues
Star history (as recorded here)
LanguageC++
LicenseApache-2.0
Created2026-09-29 (1mo ago)
Last pushtoday
OwnerUser
GitHub topics
amdcudadeepseekdistributed-inferencegfx1151ggufhipllm-inferencemixture-of-expertsmtpmulti-nodeqwenrocmspeculative-decodingstrix-halotensor-parallelunified-memoryusb4
Links
README
Loading README…