simplexai-labs / PolyStrata
git clone https://github.com/simplexai-labs/PolyStrata.git
v0.1.45-poly.7 · 6d ago
Local inference app that runs large open-weight LLMs like Qwen, GLM, DeepSeek, and Gemma on a consumer PC with OpenAI/Anthropic-compatible localhost APIs.
Why you might care
For running big models (GLM 5.3 Flash, DeepSeek V4 Flash, Qwen3.6, Gemma 4) on a single NVIDIA or AMD GPU PC without a server, with one-click installs for Windows and Linux. Nothing leaves your machine. The eight non-Strata models run on an experimental engine tested on 32 GB and 8 GB cards, so expect rough edges.
+21
stars, 24h · #1,895
+212
stars, 7 days · #1,468
+~982
stars, 30 days · #1,113
898
★ total · +31% this week
126
forks · 27 open issues
Star history (as recorded here)
LanguageC++
LicenseMIT
Created2026-10-06 (1mo ago)
Last push2d ago
Watchers9
OwnerOrganization
GitHub topics
anthropic-apicudagemmaggufglminference-enginellmlocal-llmmixture-of-expertsopenai-apiqwenself-hostedspeculative-decoding
Links
README
Loading README…
Blurb generated by claude-haiku-5-5 10d ago. Star deltas marked ~ are extrapolated from partial history.