List your company
ResearchFormerly WizWand

Speculative Decoding on Chemistry

7.1MATHedgeSpec
0.7562.4034.055.697Oct 22, 2025
Updated 6mo ago

Evaluation results

MethodLinks
HedgeSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.107.189.65
HedgeSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.106.6380.05
HedgeSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.106.6173.18
HedgeSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.106.542.86
HedgeSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.106.468.77
HedgeSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.106.2342.77
EagleBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.105.2871.28
UCBSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.105.1171.79
Vanilla EagleTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.105.0462.61
EXP3SpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.104.9364.25
UCBSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.104.8961.11
EXP3SpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.104.7662.62
UCBSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.104.7635.58
UCBSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.104.7354.37
UCBSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.104.631.76
UCBSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.5447.68
EXP3SpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.104.5433.46
EXP3SpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.104.4650.66
EXP3SpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.104.3530.13
EXP3SpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.104.3244.75
EagleBackbone=Qwen-3-8B, Inference Setting=Greedy2025.103.9844.85
Vanilla EagleTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.103.944.1
EagleBackbone=Qwen-3-32B, Inference Setting=Greedy2025.103.0121.53
Vanilla EagleTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.102.9922.4
LLaMA-3.1-8B-ITTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10117.35
Qwen-3-8BTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10114.43
Qwen-3-32BTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.1018.56
LLaMA-3.1-8B-ITBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10118.25
Qwen-3-8BBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10114.52
Qwen-3-32BBackbone=Qwen-3-32B, Inference Setting=Greedy2025.1018.33