πŸ“ˆ GH Trending Explorer 🎲 Surprise me
lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

β–² ~2.2k/7d β˜… 40k Jupyter Notebook πŸ”₯ today
microsoft / mxc

Sandboxed execution system that runs untrusted code on Windows, Linux, and macOS using OS-native sandboxes or VMs behind one policy model.

β–² ~42/7d β˜… 3.0k Rust πŸ”₯ today
NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.

β–² ~21/7d β˜… 5.4k Python πŸ”₯ today