Helldez / BigMoeOnEdge

git clone https://github.com/Helldez/BigMoeOnEdge.git

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.