A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.
SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
PyTorch native quantization for training and inference
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
Neural Network Compression Framework for enhanced OpenVINO™ inference
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
Official Code for LpWM: A Case for Sparse Representations in World Models
Local LLMs that run lean, load instantly and keep getting smarter. A from-scratch runtime + model format in Zig: zero-copy mmap, CPU/CUDA/Vulkan engines, OpenAI-compatible server, 2:4 sparsity, Net2Net growth, in-file version history, self-learning loops.