microsoft / BitNet

git clone https://github.com/microsoft/BitNet.git 🔥 on GitHub Trending today

Official C++ inference framework for 1-bit (1.58-bit) LLMs, providing optimized CPU and GPU kernels.

Why you might care

Runs BitNet b1.58 models with optimized kernels for fast, lossless inference on CPUs (ARM and x86) and GPUs, with a system paper and tech report describing the design. Suited to developers who want to run ternary-weight LLMs locally on commodity hardware instead of full-precision inference stacks.

Alternatives

llama.cppONNX RuntimevLLM

stars, 24h · #4,739

+~32

stars, 7 days · #6,042

+994

stars, 30 days · #871

41k

★ total · +0% this week

3.8k

forks · 216 open issues

Star history (as recorded here)

2026-10-20 · 41,212 ★ 2026-10-24 · 41,230 ★

LanguageC++

LicenseMIT

Created2024-08-05 (2y ago)

Last push2mo ago

Watchers369

OwnerOrganization

Seen on GitHub Trending

2026-10-24 — #11 monthly in c++ · +993 ★
2026-10-23 — #9 monthly in c++ · +994 ★
2026-10-22 — #9 monthly in c++ · +995 ★
2026-10-21 — #9 monthly in c++ · +1,029 ★
2026-10-20 — #9 monthly in c++ · +1,028 ★

README

Loading README…

Blurb generated by claude-haiku-5-5 3d ago. Star deltas marked ~ are extrapolated from partial history.