πŸ“ˆ GH Trending Explorer 🎲 Surprise me
lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

β–² ~2.2k/7d β˜… 40k Jupyter Notebook πŸ”₯ today