publicExcess / splish
Splish: a fork of Inco's Splash, tuned for Apple M5 GPUs. Apache-2.0
publicExcess / splish
gpillon / ignis
OpenAI-compatible inference server for Qwen3.8 on one RTX 5090 / RTX PRO 6000: the 27B at ~170 tok/s (peaks ~370), Flash-Next (125B MoE) at ~100 tok/s, built for local coding agents. Rust + CUDA, Windows and Linux.
mozophe / ComfyUI-Qwen-Image-2.1-PromptEnhancer-MTP
ComfyUI nodes for Qwen-Image 2.1's official prompt enhancer, run with llama.cpp or natively in ComfyUI, with MTP speculative decoding for faster generation.
shyringo / deepseek-v4-flash-0731-in-c
Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token, resident OpenAI-compatible API with function tools. | 在笔记本单颗 CPU 上本地运行原生 284B-A13B DeepSeek-V4-Flash-0731 大模型：纯 C，最低 8 GB 内存，无需 GPU，最优 TPOT 0.892 秒/token，支持模型常驻的 OpenAI 兼容接口与函数工具。
Aaqibhafeezkhan / DeHTML
Modern React and Vite toolkit for stripping HTML, encoding and decoding entities, formatting HTML, and comparing code with a built-in diff viewer. GitHub topics
1314521gjy / cyber-on-strata
在 8 GB 显存的显卡上跑 35B MoE（Cyber-Tiel-Coder-35B-A3B）：专家权重流式上卡、未命中专家由 CPU 池就地计算。Strata 引擎的 fork（MIT）。RTX 4080S 实测 8 GB 档 57.7–63.5 tok/s、全常驻 134–136 tok/s。Build from THIS repo — upstream does not support this model.
cachix / nix-archive
Byte-safe encoding, decoding, hashing, and restoration for Nix archive formats in pure Rust.
r0b0tlab / qwen38-exl3-dflash2
Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090
AlmoonYsl / DVD
Official implementation of "DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception"