Phonon: open speech recognition models (Phonon-2, Phonon-1) — CLI, CPU and CUDA images
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
Simple app to automatically switch scenes in OBS based on the current bitrate fetched from the ingest stats page.
Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger models run smoothly on the hardware you already own.
Compute-for-memory research lab for running larger LLMs on memory-constrained consumer GPUs. Official website exvram.pro