📈 GH Trending Explorer 🎲 Surprise me
lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

▲ ~2.2k/7d ★ 40k Jupyter Notebook 🔥 today
NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.