ggml-org / Llama-Windows
git clone https://github.com/ggml-org/Llama-Windows.git
v0.13.0 Β· 3d ago
π₯ on GitHub Trending today
Windows 11 system tray app for running llama.cpp models locally with a flyout chat interface and Hugging Face model downloads.
Why you might care
Gives Windows users a one-click way to run local LLMs from the tray without manual llama.cpp setup, using a Spotlight-style Alt+Space overlay for chat. Models are stored in the shared Hugging Face cache and no telemetry is sent.
β
stars, 24h
+117
stars, 7 days Β· #1,844
β
stars, 30 days
269
β
total Β· +77% this week
28
forks Β· 9 open issues
Star history starts 2026-10-23; the chart appears after the second daily snapshot.
LanguageC#
LicenseMIT
Created2026-06-29 (3mo ago)
Last push1d ago
Watchers2
OwnerOrganization
Seen on GitHub Trending
- 2026-10-23 β #7 weekly in c# Β· +117 β
Links
- GitHub: github.com/ggml-org/Llama-Windows
- Homepage: https://llama.app
- Releases Β· Issues Β· Hacker News mentions
README excerpt
# Llama **Local LLMs, one click away β right from your Windows system tray.** Llama is a Windows 11 tray app for running llama.cpp models locally. It's a WinUI 3 port of Llama for Mac. ## Install Grab the latest `.msixbundle` (x64 + ARM64) from **Releases** and double-click to install. ## Highlights - **Lives in your tray** β a borderless, Mica-backed flyout anchored to the tray icon - **Zero-setup llama.cpp** β uses your existing `llama.exe`, or downloads one for you - **One-click models** β browse and download recommended models from the Hugging Face Hub - **Model details** β click any model for a context-length picker with per-option memory estimates (read from the GGUF header), remembered per model, plus chat, copy-model-ID, curl-request, and Hugging Face actions - **Standard storage** β models live in the Hugging Face cache, shared with `llama.cpp` and other tools - **Spotlight-like overlay** β press `Alt+Space` from any app to chat with your loaded model ## The overlay `Alt+Space` from any app opens a borderless window with the WebUI for whichever model is loaded. It hides instead of closing, so re-summoning is instant and your conversation is still there. ## How it works Llama manages a `llama serve` process and talks to it over its REST API. Your models stay in the standard Hugging Face cache (`%USERPROFILE%\.cache\huggingface\hub`), shared with `llama.cpp` and HF tooling. Settings and logs live under `%LOCALAPPDATA%\Llama`. ## Privacy Llama sends no telemetry β no events, no analytics, no install id. The only thing outbound HTTP requests (model downloads, release-update checks, and calls to the local llama-server) carry is the standard User-Agent header: [code] β the app version, the Windows build, and the processor architecture. Prompts and inference stay 100% local. ## Building from source You'll need the **.NET 10 SDK** on Windows (ARM64 or x64 host; the SDK cross-builds both). The WinUI app is built per-platform β pass the matching `-p:Platform` alongside the `-r` runtime identifier: [code] bash dotnet publish LlamaApp.csproj -c Release -r win-arm64 -p:Platform=ARM64 \ --self-contained true -p:PublishReadyToRun=false -p:PublishSingleFile=false \ -o publish/win-arm64 [code] bash dotnet test LlamaApp.Tests/LlamaApp.Tests.csproj -c Release --arch x64 ``` `LlamaApp.LlamaCpp.Tests` is platform-agnostic and runs natively. ### Building the MSIX The installed release is a signed `.msix`, produced by the CI (`.github/workflows/_build.yml`) with Visual Studio MSBuild and the `GenerateAppxPackage` target β `dotnet build` alone does not pack the Appx. `dotnet publish` above is sufficient for local use. --- Made with π¦ for Windows 11 Β· Models run 100% locally β your prompts never leave your machine.
Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.