ikawrakow / ik_llama.cpp

git clone https://github.com/ikawrakow/ik_llama.cpp.git

llama.cpp fork with additional SOTA quants and improved performance