Vector (and Scalar) Quantization, in Pytorch
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
:red_circle: MiniSom is a minimalistic implementation of the Self Organizing Maps
Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger models run smoothly on the hardware you already own.