rednote-machine-learning / RedKnot

git clone https://github.com/rednote-machine-learning/RedKnot.git

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention