List your company
ResearchFormerly WizWand

Speculative Decoding on CNN_DM

1MATLLaMA-3.1-8B-IT
0.80482.12243.444.7576Oct 22, 2025
Updated 6mo ago

Evaluation results

MethodLinks
LLaMA-3.1-8B-ITTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10118.41
Qwen-3-8BTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10114.7
Qwen-3-32BTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.1018.51
LLaMA-3.1-8B-ITBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10117.86
Qwen-3-8BBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10114.49
Qwen-3-32BBackbone=Qwen-3-32B, Inference Setting=Greedy2025.1018.06
Vanilla EagleTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.102.5819.31
EagleBackbone=Qwen-3-32B, Inference Setting=Greedy2025.102.5918.67
EXP3SpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.103.3336.94
EXP3SpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.103.3724.57
EXP3SpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.103.3937.53
UCBSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.103.4524.97
UCBSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.103.5239.43
EXP3SpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.103.5225.32
UCBSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.103.5841.07
UCBSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.103.6426.93
UCBSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.103.7245.4
EXP3SpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.103.8149.7
EXP3SpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.103.8246.25
UCBSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.103.9450.47
Vanilla EagleTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.0545.47
EagleBackbone=Qwen-3-8B, Inference Setting=Greedy2025.104.0746.2
HedgeSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.104.7833.48
HedgeSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.9653.5
Vanilla EagleTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.105.0662.55
HedgeSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.105.154.97
HedgeSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.105.1933.38
EagleBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.105.3167.26
HedgeSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.105.5865.11
HedgeSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.105.8870.68