kvcache-ai / ktransformers
git clone https://github.com/kvcache-ai/ktransformers.git
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
20k
★ total
1.6k
forks · 524 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2024-07-26 (2y ago)
Last pushtoday
OwnerOrganization