ashhart / TensorFold

Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.

microsoft / BitNet

Official C++ inference framework for 1-bit (1.58-bit) LLMs, providing optimized CPU and GPU kernels.