Niko1221 / Strata

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

freriadoc / Avalon

Fast fork of llama.cpp designed for Qwen3.8-Flash-Next

simplexai-labs / PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

1314521gjy / ninfer-fusion-kvmem

Experimental Windows/NVIDIA GPU long-context inference engine (C++) with KV-cache paging to host memory, a downstream fork of NInfer.