Demo scripts for running PrismML's Bonsai 2 small LLMs (2B to 27B) locally on Mac, Linux, Windows, or CPU.
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install
Bonsai 2 27B: 262k context (trained max) on 12 GB, 54 to 97 tok/s decode, 2x prefill, q8_0 KV recipe, grammar tool calls 9/9. Same ternary weights. Windows bundle + receipts.
The procedural generation voxel engine
Rust implementation of behavior trees for deterministic AI (now with Python bindings)
Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
Runtime behavioral ablation for compressed LLMs. First target: Ternary Bonsai 2 27B — no weight modification or re-quantization. by OrcaRouter team
Ternary (2.125 bit/weight) Bonsai 2 27B on the NINFER engine — Ada sm_89, Linux. Derivative work of Neroued/ninfer; see README.
Bonsai-27B x NInfer local deployment project (RTX 5080, ternary quantization)
Ternary Bonsai 2 27B MLX inference speedup benchmark engine
Windows本地bonsai模型部署启动器
Your GitHub history drawn as a bonsai. Commits grow foliage, merged PRs ripen into fruit, reviews hang lanterns, streaks blossom. It's one image URL you drop in your profile README, and it redraws every day from your real numbers.
🥷 Give your codebase a black belt. Local code intelligence, security analysis, and compiler-backed facts for humans and AI.
Make LM Studio load Ternary Bonsai 2 GGUF (PQ2_0 / PTQ1_0) via Prism's llama.cpp fork, with reasoning-effort selector. Linux + Windows, double-click install.
llama-cli release for apple
A lightweight Model Context Protocol (MCP) server for safe Obsidian vault access