vllm-project / llm-compressor

git clone https://github.com/vllm-project/llm-compressor.git

State-of-the-art LLM compression, built for production inference with vLLM