NVIDIA / kvpress

git clone https://github.com/NVIDIA/kvpress.git

LLM KV cache compression made easy

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

1.2k

★ total

192

forks · 10 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguagePython

LicenseApache-2.0

Created2024-11-06 (1y ago)

Last push1d ago

OwnerOrganization

GitHub topics

inference kv-cache kv-cache-compression large-language-models llm long-context python pytorch transformers

Links

GitHub: github.com/NVIDIA/kvpress
Releases · Issues · Hacker News mentions