rednote-machine-learning / RedKnot
Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
rednote-machine-learning / RedKnot
rednote-machine-learning / RedKnot
rednote-machine-learning / RedKnot
Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention