tardellirs / gemma3moe-builder

git clone https://github.com/tardellirs/gemma3moe-builder.git

Sparse-upcycle a dense Gemma-3-270m into a Mixture-of-Experts (gemma3moe) and serve it on llama.cpp (CPU). Upcycle, train, inspect routing, GGUF.