0xBakeer / Qwen3.8-27B-4-bit-on-a-single-DGX-Spark

git clone https://github.com/0xBakeer/Qwen3.8-27B-4-bit-on-a-single-DGX-Spark.git

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4-AutoRound vs the FP8 baseline, measured on one harness — including why the quantization advantage collapses to +0.2% by c16.