Search: fastertransformer · Language: Python · clear
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.