intel / neural-compressor
git clone https://github.com/intel/neural-compressor.git
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
2.7k
★ total
330
forks · 30 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2020-07-21 (6y ago)
Last pushtoday
OwnerOrganization
GitHub topics
auto-tuningawqfp4gptqint4int8knowledge-distillationlarge-language-modelslow-precisionmxformatpost-training-quantizationpruningquantizationquantization-aware-trainingsmoothquantsparsegptsparsity