Michael-A-Kuykendall / shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

pegainfer-project / pega-omni

OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.

alvarobartt / sys1

Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.