Qwen3.8-27B INT8/W8A8 optimization for Hygon K100AI: SGLang, TP1/TP4, DFlash2 and long-context Agent workloads
Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, MiniMax-H3.
DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)
Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts images. Zero dependencies.
Reproducible Qwen3.8-27B NVFP4 + DFlash2 recipe and qualification evidence for one NVIDIA DGX Spark
GLM-5.3-Flash (FP8) + DFlash2 speculative decoding on 4x NVIDIA DGX Spark / ASUS GX10: vLLM TP4, 256K context, switchless ConnectX-7 ring with patched NCCL
GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe
GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to 1.04M; abliteration with blackforest_AI next
DeepSeek-V4.1-Flash on 4x DGX Spark TP4 switchless RoCE ring - SGLang production recipe, 600K context, DSpark MTP, benchmark archive
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.
双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM:NVIDIA NVFP4、GDS、TEP2、MTP6,支持 1~10 并发,词表与 PCIe 通信优化。中英文部署与可构建源码。
Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node DGX Spark fabric.
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
Argolink-focused cost-aware coding model selection for DeepSeek V4.1 Flash.
Turn YouTube videos, PDFs, and notes into AI-generated active-recall flashcards with spaced repetition, fact verification, and Telegram review reminders.
Serving large LLMs on a single DGX Spark (121 GiB): Qwen3.8-Flash-Next on TensorFold/SparkFold EXL3 and vLLM NVFP4, Nemotron 3.5 Super VL on vLLM; what ran, what it measured, what did not work
Open-source tablet-first MicroPython IDE over Bluetooth Low Energy, with the PBLE/1 protocol, portable firmware agent, and browser flasher.
A Deepseek V4 Flash 0731 / Vision Exp VLLM stack
vLLM recipe: GLM-5.3-Flash EXL3 K2 on one DGX Spark GB10. Native MTP k=2. Measured tok/s.
Apache-2.0 exact-method recipe for non-Flash GLM-5.3 BF16 DWM32 alpha 2.2
Qwen3.8-27B on DGX Spark (GB10): SGLang + NVFP4 + DFlash2. Measured recipe, benchmark harness, and the traps that cost real time.
Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090
setup guide for deepseek-flash-0731 on two dgx-spark from scratch