Speculative Decoding on Chemistry
7.1MATHedgeSpec
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| HedgeSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10 | 7.1 | 89.65 | |
| HedgeSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10 | 6.63 | 80.05 | |
| HedgeSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10 | 6.61 | 73.18 | |
| HedgeSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.10 | 6.5 | 42.86 | |
| HedgeSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10 | 6.4 | 68.77 | |
| HedgeSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.10 | 6.23 | 42.77 | |
| EagleBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10 | 5.28 | 71.28 | |
| UCBSpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10 | 5.11 | 71.79 | |
| Vanilla EagleTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10 | 5.04 | 62.61 | |
| EXP3SpecBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10 | 4.93 | 64.25 | |
| UCBSpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10 | 4.89 | 61.11 | |
| EXP3SpecTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10 | 4.76 | 62.62 | |
| UCBSpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.10 | 4.76 | 35.58 | |
| UCBSpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10 | 4.73 | 54.37 | |
| UCBSpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.10 | 4.6 | 31.76 | |
| UCBSpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10 | 4.54 | 47.68 | |
| EXP3SpecBackbone=Qwen-3-32B, Inference Setting=Greedy2025.10 | 4.54 | 33.46 | |
| EXP3SpecBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10 | 4.46 | 50.66 | |
| EXP3SpecTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.10 | 4.35 | 30.13 | |
| EXP3SpecTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10 | 4.32 | 44.75 | |
| EagleBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10 | 3.98 | 44.85 | |
| Vanilla EagleTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10 | 3.9 | 44.1 | |
| EagleBackbone=Qwen-3-32B, Inference Setting=Greedy2025.10 | 3.01 | 21.53 | |
| Vanilla EagleTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.10 | 2.99 | 22.4 | |
| LLaMA-3.1-8B-ITTarget Model=LLaMA-3.1-8B-IT, Inference Mode=Non-greedy2025.10 | 1 | 17.35 | |
| Qwen-3-8BTarget Model=Qwen-3-8B, Inference Mode=Non-greedy2025.10 | 1 | 14.43 | |
| Qwen-3-32BTarget Model=Qwen-3-32B, Inference Mode=Non-greedy2025.10 | 1 | 8.56 | |
| LLaMA-3.1-8B-ITBackbone=LLaMA-3.1-8B-IT, Inference Setting=Greedy2025.10 | 1 | 18.25 | |
| Qwen-3-8BBackbone=Qwen-3-8B, Inference Setting=Greedy2025.10 | 1 | 14.52 | |
| Qwen-3-32BBackbone=Qwen-3-32B, Inference Setting=Greedy2025.10 | 1 | 8.33 |