mozilla-ai / llamafile
Distribute and run LLMs with a single file.
mozilla-ai / llamafile
ollaya-dev / ollaya
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
local-inference-lab / rtx6kpro
RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink
ardanlabs / kronk
Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.
alesha-pro / tools
Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig
Phocinae / Phocinae-Largha-150M-v1
斑海豹 — Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions. 小海豹，大决断。
SpinnerAppreciate / glm-flash-offline-client
Offline desktop client for GLM-5.3-Flash — run private, local chat sessions without a server connection.
sahibzada-allahyar / gliner2-ultrafast
Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.
bladedevoff / stuntd
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI compatible.
yzfly / edgejev
离线可用的本地类型化决策：4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev
EldanRing / winnow-inference
Local typed decisions, chat and vision with Winnow-12B and llama.cpp