thu-pacman / chitu

git clone https://github.com/thu-pacman/chitu.git

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.