📈 GH Trending Explorer 🎲 Surprise me

Search: quantization · Language: Python · clear

WestWaters / pollard-weights

A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.

▲ ~0/7d ★ 28 Python today
vcruz305 / vllm-exl3

Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with source-format non-routed weights

▲ ~0/7d ★ 26 Python 1d ago
r0b0tlab / qwen38-exl3-dflash2

Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090