VecSzn / PolyStrata

PolyStrata 
**English** · 简体中文 · 日本語 · Deutsch · Français · Español · Português
 Run large AI models on your own PC 
Qwen3.8-Flash-Next, GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V · free and open source 
 Claude Code on Qwen3.6-35B-A3B UD-Q3_K_M, on the laptop with the 8 GB card, in real time: it adds a --json option to a small program, writes a test for it and runs the tests. The server had read Claude Code's system prompt when it started ( "warm_start": true ). 
 A voxel pagoda garden, 1 shot prompt running on an RTX 5070 with Strata (Qwen3.8-Flash-Next IQ3_S, 128K context) ·
 full video (49 s) 
PolyStrata runs large AI models on a normal PC, models that usually need a server. They chat, write code and work
with your apps and coding agents. Nothing leaves your PC.
It runs nine models, on two engines:
- **Qwen3.8-Flash-Next** on an NVIDIA or AMD graphics card with
 12 GB or more, on Windows or Linux. It also reads pictures. Its engine is the Strata project's, unchanged.
The other eight run on an engine written for PolyStrata, with one NVIDIA card or two: on Linux, and the six smaller ones on
Windows too. They are experimental: they have run on one PC with a 32 GB card, and the six smaller ones on a laptop
with an 8 GB card as well.
- **GLM 5.3 Flash**, the largest: a file of 79 to 114 GB, most of which stays in RAM.
- **DeepSeek V4 Flash**, a file of 91 GB, most of which stays in RAM too. Its memory of a
 conversation is small: a 128K context takes 0.7 GB more VRAM than 32K.
- **LFM2.5-24B-A2B** by Liquid AI, a file of 11 to 25 GB. Most of its layers have no attention, so a
 long conversation takes little VRAM: a 128K context takes 2 GB more than 32K. Its license allows commercial use
 only to companies with less than 10 million dollars of yearly revenue.
- **Qwen3.6-35B-A3B**, a file of 13 to 23 GB. It also reads pictures.
- **Ornith 1.5**, which has Qwen3.6-35B-A3B's architecture and other weights: a file of 14 to 24 GB. It
 also reads pictures.
- **Gemma 4 26B-A4B**, a file of 11 to 17 GB. It also reads pictures.
- **Tiel Coder 35B-A3B**, Ornith 1.5 quantized for coding agents by peculiar-ragdoll: a file of
 14 to 23 GB. It also reads pictures.
- **MiniCPM-V 4.7 35B-A3B** by OpenBMB, which has Qwen3.6-35B-A3B's architecture and weights of its
 own, made to read pictures: a file of 16 to 29 GB.
The server can change between installed models while it runs (how).
PolyStrata is built on Strata by Niko1221.
Why it is a separate repo, AMD and smaller cards, fine-tunes and other questions: FAQ.
## How fast is it?
A token is about ¾ of a word.
- **Writes answers:** how fast the reply appears in a short chat. 60 tokens per second is faster than you can read.
- **Reads your prompt:** how fast it takes in what you send (a document, code or a chat history).
### Qwen3.8-Flash-Next
Measured by the Strata project on two ordinary gaming PCs, with a 32K-token prompt.
 NVIDIA: RTX 5070 (12 GB), Ryzen 5 7600