magnitudedev / magnitude
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.
magnitudedev / magnitude
midagedev / bloomery
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.
CLoaKY233 / siltop
Terminal system monitor for Apple Silicon Macs: CPU, GPU, power, temperatures, processes.
bvaisvil / zenith
Zenith - sort of like top or htop but with zoom-able charts, CPU, GPU, network, and disk usage
cloud-hypervisor / cloud-hypervisor
A Virtual Machine Monitor for modern Cloud workloads. Features include CPU, memory and device hotplug, support for running Windows and Linux guests, device offload with vhost-user and a minimal compact footprint. Written in Rust with a strong focus on security.
rbspy / rbspy
Sampling CPU profiler for Ruby
vladkens / macmon
🦀🌡️ Real-time system monitor for Apple Silicon Macs (M1–M5). No sudo. TUI, JSON/Prometheus metrics server, and Rust library.
hotpath-rs / hotpath
Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.
intentee / paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
davidB / kubectl-view-allocations
kubectl plugin to list allocations (cpu, memory, gpu,... X utilization, requested, limit, allocatable,...)
lucienhuangfu / eLLM
eLLM: Run Long-Horizon Inference Faster on CPUs Than on GPUs
starkware-libs / cairo-vm
cairo-vm is a Rust implementation of the Cairo VM. Cairo (CPU Algebraic Intermediate Representation) is a programming language for writing provable programs, where one party can prove to another that a certain computation was executed correctly without the need for this party to re-execute the same program.
R44VC0RP / isocast
Free, open-source OBS alternative for Mac: scenes and sources, every source recorded as its own file (ISO), about half OBS's CPU, CLI and MCP control. Rust, Apple silicon.
antonellof / frink
Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.
Ak4ai / Litecord
🚀 Ultra-lightweight, high-performance native Discord client in Rust for gamers (< 0.1% CPU, ~32MB RAM, 1080p60 FPS stream, E2EE voice)
ushironoko / rust-cpu-gpu-book
RustではじめるCPUとGPU — Webアプリケーション開発者のための、RustでたどるCPU・GPUの教科書 (28章、インタラクティブ実行つき)
Dicklesworthstone / franken_tts
Pure-Rust, CPU-hyper-optimized runtime for Qwen3-TTS zero-shot voice cloning — turns the model's hidden 15-step residual-code microdecoder from its largest CPU liability into its largest optimization advantage
open-nexa / cpum
—