Dharshaneshwaran / hyperpod
git clone https://github.com/Dharshaneshwaran/hyperpod.git
Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.
+6
stars, 24h · #6,148
+~42
stars, 7 days · #6,716
+55
stars, 30 days · #15,538
55
★ total · +42% this week
0
forks · 0 open issues
Star history (as recorded here)
LanguageGo
LicenseApache-2.0
Created2026-10-26 (11d ago)
Last push5d ago
OwnerUser
GitHub topics
cudadistributed-inferencefault-toleranceggufgolanggpu-telemetryllamallama-cpplocal-llmmetalreactrust
Links
README
Loading README…