nobodywho-ooo / nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

gavamedia / deltafin

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

BigStrongSun / ccswitchmulti

CCswitch的全面升级，专门优化codex体验。支持官方订阅和第三方模型混用，自动路由，支持v2subagent使用第三方模型

maximpri / mlxtop

A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more

antonellof / frink

Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.

gpillon / ignis

OpenAI-compatible inference server for Qwen3.8 on one RTX 5090 / RTX PRO 6000: the 27B at ~170 tok/s (peaks ~370), Flash-Next (125B MoE) at ~100 tok/s, built for local coding agents. Rust + CUDA, Windows and Linux.

gromhacks / bonsai-ninja

🥷 Give your codebase a black belt. Local code intelligence, security analysis, and compiler-backed facts for humans and AI.

Encapsul / daedalus

Package an app into one self-extracting Linux ELF. CLI on Linux/macOS/Windows; artifact runs on Linux. CI smoke: examples/hello-web.

hongfaqiu / strata-manager

Strata Manager makes Niko1221/Strata, the local LLM inference engine, easier to set up and use. Manage local models and services, monitor hardware and API usage, chat and tune inference. Open-source desktop app for Windows / Linux x64.