local-inference-lab / rtx6kpro
RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink
local-inference-lab / rtx6kpro
Phocinae / Phocinae-Largha-150M-v1
斑海豹 — Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions. 小海豹，大决断。
sahibzada-allahyar / gliner2-ultrafast
Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.
bladedevoff / stuntd
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI compatible.
yzfly / edgejev
离线可用的本地类型化决策：4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev
EldanRing / winnow-inference
Local typed decisions, chat and vision with Winnow-12B and llama.cpp