Michael-A-Kuykendall / shimmy
git clone https://github.com/Michael-A-Kuykendall/shimmy.git
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
+0
stars, 24h · #59,431
+~2
stars, 7 days · #35,440
+~8
stars, 30 days · #38,793
6.0k
★ total · +0% this week
587
forks · 9 open issues
Star history (as recorded here)
LanguageRust
LicenseApache-2.0
Created2025-08-28 (1y ago)
Last push6d ago
OwnerUser
GitHub topics
api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-aimachine-learningollama-apiopenai-compatiblerustrust-cratetransformerswebgpuwebgpu-shaders
Links
README
Loading README…