List your company
ResearchFormerly WizWand

Speculative Decoding on Biology

7.18MATHedgeSpec
0.75282.42144.095.7586Oct 22, 2025
Updated 6mo ago

Evaluation results

MethodLinks
HedgeSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.107.1893.78
HedgeSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.106.6782.22
EagleBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.105.9571.2
HedgeSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.105.9339.13
Vanilla EagleTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.105.7474.41
HedgeSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.105.6662.08
HedgeSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.105.5660.8
HedgeSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.105.4438.54
UCBSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.105.2270.27
EXP3SpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.104.9367.7
UCBSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.104.964.53
EXP3SpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.104.6760.28
UCBSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.104.2531.73
UCBSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.104.1647.29
EXP3SpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.104.130.31
UCBSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.104.0830.14
Vanilla EagleTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.0747.13
UCBSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.0745.8
EagleBackbone=Qwen-3-8B, Inference Setting=Greedy2025.104.0646.22
EXP3SpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.104.0346.5
EXP3SpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.103.9628.04
EXP3SpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.103.8843.07
EagleBackbone=Qwen-3-32B, Inference Setting=Greedy2025.102.6219.3
Vanilla EagleTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.102.5219.25
LLaMA-3.1-8B-ITTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10118.03
Qwen-3-8BTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10114.95
Qwen-3-32BTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.1018.35
LLaMA-3.1-8B-ITBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10118.44
Qwen-3-8BBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10114.64
Qwen-3-32BBackbone=Qwen-3-32B, Inference Setting=Greedy2025.1018.43