lxe / dsx

DeepSeek-V4.1-Flash-1017 (552B MoE) on 2x RTX 3090 + 128 GB RAM: Rust + CUDA engine and 2-bit quant. 30-37 tok/s decode.

andyzpb / localMoE

Run DeepSeek-v4-pro (1600B MoE) on a 24GB-RAM consumer machine — rust, streamed from disk.