dolf3131 / dgx-spark-llm-serving

git clone https://github.com/dolf3131/dgx-spark-llm-serving.git

Serving large LLMs on a single DGX Spark (121 GiB): Qwen3.8-Flash-Next on TensorFold/SparkFold EXL3 and vLLM NVFP4, Nemotron 3.5 Super VL on vLLM; what ran, what it measured, what did not work