ernie-research / DCore

git clone https://github.com/ernie-research/DCore.git

Speculative decoding has plenty of tricks. Which ones actually make LLMs faster? Explore 7 methods, 26 checkpoints, and a shared training and evaluation framework.