Tylogi / TyloQuant
git clone https://github.com/Tylogi/TyloQuant.git
Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger models run smoothly on the hardware you already own.
+0
stars, 24h · #23,896
+~0
stars, 7 days · #32,381
+~0
stars, 30 days · #36,009
86
★ total
14
forks · 4 open issues
Star history (as recorded here)
LanguageC++
LicenseApache-2.0
Created2026-07-24 (3mo ago)
Last push1d ago
OwnerOrganization
GitHub topics
apple-siliconcudadeepseekgemmaggufllmllm-inferencellm-quantizationlocal-llmlow-bitmetalminicpmmixed-precisionmixture-of-expertsmlxmoeopenai-apiquantizationqwenvector-quantization