List your company
ResearchFormerly WizWand

Speculative Decoding Evaluation on OOD Mean

5.21SpeedupFLy
1.29962.31483.334.3452Nov 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.115.2118.89
FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.114.817.13
SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.112.8314.58
FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.112.7412.41
FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.112.6212.44
FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=12025.112.5611.75
FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=02025.112.5311.35
SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.112.3912.17
TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.112.13.52
TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.112.083.47
SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.112.0410.91
SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11210.71
RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.111.791.91
TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.111.683.31
TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.111.683.31
RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.111.671.78
RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.111.621.81
EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=02025.111.562.5
RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.111.551.73
EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=12025.111.452.31