DominikBucko / qwen38-flash-next-2x3090
git clone https://github.com/DominikBucko/qwen38-flash-next-2x3090.git
Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,865 tok/s; with 64 GB RAM 3,410 tok/s prefill · 84 tok/s decode. New: opt-in uncensored mode (runtime abliteration, no new weights).
+0
stars, 24h · #31,871
+~5
stars, 7 days · #18,018
+~22
stars, 30 days · #22,644
125
★ total · +4% this week
16
forks · 9 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-08-30 (1mo ago)
Last push9d ago
OwnerUser
GitHub topics
256k-contextcpu-offloadingdual-gpufp8int4llm-inferencelocal-llmmoemtpmulti-gpuquantizationqwenqwen3-8qwen3-8-flash-nextqwen38rtx-3090rtx3090rtx4090speculative-decodingvllm
Links
- GitHub: github.com/DominikBucko/qwen38-flash-next-2x3090
- Homepage: https://huggingface.co/albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE
- Releases · Issues · Hacker News mentions
README
Loading README…