hardenedlinux / SonicBoom

git clone https://github.com/hardenedlinux/SonicBoom.git

A compiler-first PyTorch alternative. MLIR-based Boom IR, Guile scripting, CUDA and CPU. On consumer GPUs it already beats llama.cpp’s LLM decode with the same kernels; the compiler makes the difference. GPLv3.