Niko1221 / Strata
git clone https://github.com/Niko1221/Strata.git
v0.2.1 · 4d ago
Desktop inference app that runs the 125B Qwen3.8-Flash-Next model locally with OpenAI and Anthropic compatible APIs on localhost.
Why you might care
Lets you run a large model on a 32 GB+ gaming PC, Mac, or unified-memory system without a server. Coding agents like Claude Code and Codex CLI can connect to it, and chats and files stay on your machine. MIT licensed with no account or telemetry.
+574
stars, 24h · #36
+~3.9k
stars, 7 days · #43
+31k
stars, 30 days · #9
31k
★ total · +14% this week
3.4k
forks · 816 open issues
Star history (as recorded here)
LanguageC++
LicenseMIT
Created2026-09-24 (1mo ago)
Last pushtoday
Watchers154
OwnerUser
Links
- GitHub: github.com/Niko1221/Strata
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.