Niko1221 / Strata
git clone https://github.com/Niko1221/Strata.git
v0.2.1 · 2d ago
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
+278
stars, 24h · #35
+~1.9k
stars, 7 days · #59
+29k
stars, 30 days · #5
30k
★ total · +7% this week
3.2k
forks · 597 open issues
Star history (as recorded here)
LanguageC++
LicenseMIT
Created2026-09-24 (27d ago)
Last pushtoday
Watchers154
OwnerUser
Links
- GitHub: github.com/Niko1221/Strata
- Releases · Issues · Hacker News mentions
README excerpt
English · 简体中文 · 日本語 · Deutsch · Français · Español · Português Run a state-of-the-art model on your own gaming PC Support for NVIDIA, AMD, Intel · Windows, Linux, Mac · free and open source A voxel pagoda garden, 1 shot prompt running on an RTX 5070 with Strata (IQ3_S, 128K context) · full video (49 s) Strata runs **Qwen3.8-Flash-Next**, a 125-billion-parameter model that normally needs a server, on a normal PC. It chats, writes code, reads pictures and works with your apps and coding agents. Your chats and files stay on your PC. **New here?** Check what you need, then install the app. - **Runs on a gaming PC.** 32 GB of RAM and graphics memory together is enough to start. - **Works with your tools.** It speaks the OpenAI and Anthropic APIs, so Claude Code, Codex CLI, OpenCode and other agents connect to it. - **Reads pictures.** They are on by default. - **Free.** MIT license, no account, no cloud. - **Private.** No telemetry. What Strata downloads, when it uses the internet and how it checks downloads is in docs/SAFETY.md. Version 0.2.1 · engine 0.1.46 ## What you need **You need at least 32 GB of RAM and graphics memory (VRAM) together.** On a Mac or a Ryzen AI Max, that is the unified memory. More memory gives a bigger model or a faster one. - A 32 GB PC with a 12-16 GB card runs the Coder. - 64 GB of RAM runs every size. | Your computer | Details | | --- | --- | | **NVIDIA** GeForce RTX 20, 30, 40, 50 series (12 GB or more) | Install the app or the Terminal. | | **AMD** Radeon RX 6800 and newer, Radeon AI PRO R9700 (12 GB or more) | AMD cards | | **Intel** Arc | Intel Arc, Intel engine | | **Apple Silicon Mac** (M1 or newer, macOS 15 or newer) | Mac | | **AMD Ryzen AI Max (Strix Halo)** and other unified-memory systems | Strix Halo | | Older cards and processors | Older GPUs, Older CPUs | Also needed: - about 80 GB of free disk (an SSD makes the first start much faster) - Windows 10 / 11, Linux or macOS - a current graphics driver Two or three cards of the same make can share a model (multi-GPU). Strata never splits a model across NVIDIA and AMD cards. Full list: docs/INSTALL.md. ## Install Pick one option. They all start the same engine and use the same models. ### Option A: the Strata app The easiest way. The app has the engine inside: install it, pick a model, chat. Download the file for your system and graphics card from the releases page. Not sure which one? See the line under the table. | System | Your graphics card | File to download | | --- | --- | --- | | **Windows 10 / 11** | NVIDIA RTX, driver 580 or newer | `Strata-0.2.1-windows-cuda13.exe` | | | NVIDIA, older card or driver older than 580 | `Strata-0.2.1-windows-cuda12.exe` | | | AMD Radeon RX 9000 series or Radeon AI PRO R9700 | `Strata-0.2.1-windows-hip.exe` | | | AMD Radeon RX 7000 series or Ryzen AI Max (Strix Halo) | `Strata-0.2.1-windows-hip-rdna3.exe` | | **Linux** | NVIDIA RTX, driver 580 or newer | `Strata-0.2.1-linux-nvidia-cuda13.AppImage` | | | NVIDIA, older