rednote-machine-learning / RedKnot

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

jmaczan / tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

amitshekhariitbhu / llm-inference-engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

52Hz-kiko / mini-vllm-qwen3-serving

A Mini-vLLM optimization project for Qwen3-32B TP=2 serving, Prefix Cache, and Triton PagedAttention.

lora-sys / nano-vllm-interactive-guide

面向开发者与初学者的 nano-vLLM 交互式源码教程 - 通过 13 个 HTML 互动实验 + 13 章中文教程理解大模型推理引擎