vcruz305 / vllm-exl3

git clone https://github.com/vcruz305/vllm-exl3.git

Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with source-format non-routed weights