Official C++ inference framework for 1-bit (1.58-bit) LLMs, providing optimized CPU and GPU kernels.
7-node ESP32-S3 cluster running a 0.4B LLM via 1.58-bit (BitNet) ternary quantization over SPI daisy-chain
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch