mudler / LocalAI

Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.

microsoft / BitNet

Official C++ inference framework for 1-bit (1.58-bit) LLMs, providing optimized CPU and GPU kernels.

PrismML-Eng / Bonsai-demo

Demo scripts for running PrismML's Bonsai 2 small LLMs (2B to 27B) locally on Mac, Linux, Windows, or CPU.