baidu / vLLM-ERNIE

git clone https://github.com/baidu/vLLM-ERNIE.git

vLLM-based inference plugin for the open-source ERNIE models.