52Hz-kiko / mini-vllm-qwen3-serving

git clone https://github.com/52Hz-kiko/mini-vllm-qwen3-serving.git

A Mini-vLLM optimization project for Qwen3-32B TP=2 serving, Prefix Cache, and Triton PagedAttention.