cobanov / PS5LM

PS5LM 
 Your PS5 runs the language model. Every device on your network uses it. 
 llama.cpp on the console's GPU, with OpenAI and Anthropic APIs and a screen made for the TV.
 Get the app ·
 Website ·
 Get started ·
 Issues 
> **New: decision models, powered by Ollaya.** PS5LM now runs Jev-like
> decision models (d1, Clef, OpenJev and more) on the GPU and answers the same `/v1/systemone`
> API as Ollaya: typed decisions with calibrated probabilities, in a fraction of a second.
PS5LM is for anyone with a jailbroken PS5 who wants a private model server at home. It loads a GGUF
model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs
no PC while it runs, no cloud and no account.
 Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video. 
 Home, Models, Console, API and Settings on the TV. 
## A model server under your TV
- **It runs on the GPU.** llama.cpp's Vulkan backend on the console's RDNA 2 GPU, with 11.4 GB of the
 shared memory for the model and its context. Every architecture and quantization llama.cpp knows
 comes along.
- **It answers your network.** OpenAI's `/v1/chat/completions`, Anthropic's `/v1/messages` (Claude Code
 works against it) and a chat page in any browser. Point a client at `http:// :8081` and use
 any model name: the loaded one answers.
- **It decides, too.** Load a decision model and the console answers TypeSafe's `/v1/systemone`:
 choice, score and yes-or-no questions about text and images, the API Ollaya serves on a PC.
- **It shows its work.** Every request streams across the TV as a chat: which device asked, what it
 asked, and the reply as it is written. Square sends a demo and Triangle opens a keyboard, so the
 console can be tried from the couch.
- **It watches the console.** A Console page charts temperature, power, GPU and CPU load over the
 last two minutes or the last hour, beside a table of every reading.
- **It picks what fits.** The planner reads each GGUF and gives it the longest context and best cache
 that fit the memory free. A Suggested list holds models measured on the console, and the app
 downloads from Hugging Face by itself, to internal storage, the M.2 drive or a USB drive.
- **It reads images.** Models with an image projector (Gemma 4, MiniCPM-V, d1) take pictures in chat
 and in decisions.
| Model | Size | On a PS5 Slim |
|---|---|---|
| Qwen 3.5 0.8B, Q4_K_M | 0.5 GB | 207 tokens a second |
| Qwen 3.5 9B, Q4_K_M | 5.3 GB | 55 tokens a second |
| Qwen 3.8 27B, UD-Q2_K_XL | 9.2 GB | about 20 tokens a second, 64k context |
| d1 Omni 600M, a decision model | 1.1 GB | 3 questions in 0.3 s; a 720p image and 7 questions in 2.9 s |
## Decision models, powered by Ollaya
Ollaya runs open decision models on a PC the way Ollama runs
language models. PS5LM brings the same idea to the console: a decision model reads a state and
answers typed questions in one forward pass, with no text generated.
 [code] 
The Suggested list has d1 Omni 600M,