vladimirrott / mojo-dllm
git clone https://github.com/vladimirrott/mojo-dllm.git
v0.1.0 · 1mo ago
Local CPU and NVIDIA GPU inference for LLaDA-8B and Dream-7B diffusion language models from quantized GGUF files, written in Mojo.
Why you might care
Runs diffusion LLMs without Python at runtime, with the GGUF reader, tokenizer, quantized matmul, GPU kernels and denoising loop all in Mojo. Its README benchmarks show it ahead of llama.cpp's diffusion CLI on the CPU run it tested (1.33 vs 0.69 tokens/s), and GPU is optional.
+60
stars, 24h · #734
+311
stars, 7 days · #921
+~1.3k
stars, 30 days · #830
367
★ total · +311% this week
6
forks · 98 open issues
Star history (as recorded here)
LanguageMojo
LicenseApache-2.0
Created2026-10-04 (1mo ago)
Last push1d ago
Watchers1
OwnerUser
GitHub topics
Links
- GitHub: github.com/vladimirrott/mojo-dllm
- Homepage: https://vladimirrott.github.io/mojo-dllm/
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 6d ago. Star deltas marked ~ are extrapolated from partial history.