NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.

pytorch / pytorch

Python library providing GPU-accelerated tensor computation like NumPy, plus a tape-based autograd system for building deep neural networks.