kvcache-ai / Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
kvcache-ai / Mooncake
redhat-et / ripwire
The ripgrep of AI context: a zero-dependency C++23 CLI + MCP server for coding agents. Find what you want without reading the repo, then check you built what you meant — blast radius, tests-to-run, quality deltas. Signatures at 74.7% fewer bytes than bodies; every guess labelled, every loss published. Paddle out with a map.
shawnshekari / strixite
LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context
google / sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
JakeATX / llamAmpere
llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx
bab2min / Kiwi
Kiwi(지능형 한국어 형태소 분석기)
5258MF / ninfer-rtx3060-27b
RTX 3060 12GB/8GB 本地跑 27B 大模型：256K 上下文、约 45 token/秒，能看图、调工具，附懒人包和源码
localai-org / skin-tokens.cpp
C++/GGML conversion of VAST-AI SkinTokens; Auto rigs a mesh ready for animation
nbs32k / LocalStranger
PoC for WinNotify, demonstrated through a driver mapper, and local privilege escalation.
Thalhammer / jwt-cpp
A header only library for creating and validating json web tokens in c++
hec-ovi / text-to-3D-skill
Local text to textured GLB on an AMD Strix Halo iGPU (gfx1151): FLUX.2 klein, a Vulkan-only TRELLIS.2 engine, and humanoid auto-rigging with SkinTokens on ROCm. No Blender, no CUDA.