FlashMLA: Efficient Multi-head Latent Attention Kernels
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
Official inference framework for 1-bit LLMs