LLM speculative inference server for heterogeneous hardware & consumer GPUs
Mirage Persistent Kernel: Compiling LLMs into a MegaKernel
Mixture-of-experts (MoE) training megakernel for NVL72s
A collection of megakernels for TPU
—
Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL