lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

crmne / ruby_llm

Ruby framework for building AI features with a unified API across 23 model providers, tools, agents, and Rails conventions.