lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

anthropics / knowledge-work-plugins

Open-source plugins that specialize Claude for knowledge-work roles like sales, legal, finance, and support, for use in Claude Cowork.

trymirai / uzu

Inference engine for running AI models locally inside apps, with Rust core and Swift, Python, and TypeScript bindings.

sp00nznet / ps3recomp

Static recompilation runtime libraries and analysis tools for translating PlayStation 3 binaries into native C/C++ executables.

lionsoul2014 / ip2region

Offline IP-to-region lookup library and data management framework supporting IPv4 and IPv6 with xdb query clients.

facebookresearch / audiocraft

PyTorch library for audio generation research, providing inference and training code for MusicGen, AudioGen, and EnCodec.

NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.

FluidInference / FluidAudio

Swift SDK running open-source speech models (ASR, TTS, VAD, speaker diarization) locally on Apple devices via CoreML and the Neural Engine.