Mathematical Reasoning on AIME (Speedup)
4.4SpeedupFailFast
Evaluation results
| Method | Links | |
|---|---|---|
| FailFastTarget Model=Qwen2.5-32B-Instruct2025.12 | 4.4 | |
| FailFastTarget Model=Qwen2.5-14B-Instruct2025.12 | 3.37 | |
| Fast-dLLMTarget Model=Qwen2.5-32B-Instruct2025.12 | 3.29 | |
| EAGLE-3 (w/ draft tree)Target Model=Qwen2.5-32B-Instruct2025.12 | 2.85 | |
| AR Draft ModelTarget Model=Qwen2.5-32B-Instruct2025.12 | 2.84 | |
| FailFastTarget Model=Qwen2.5-7B-Instruct2025.12 | 2.63 | |
| EAGLE-3 (w/ draft tree)Target Model=Qwen2.5-14B-Instruct2025.12 | 2.38 | |
| EAGLE-3 (w/ draft tree)Target Model=Qwen2.5-7B-Instruct2025.12 | 2.36 | |
| Fast-dLLMTarget Model=Qwen2.5-14B-Instruct2025.12 | 2.22 | |
| AR Draft ModelTarget Model=Qwen2.5-14B-Instruct2025.12 | 1.94 | |
| Fast-dLLMTarget Model=Qwen2.5-7B-Instruct2025.12 | 1.57 | |
| AR Draft ModelTarget Model=Qwen2.5-7B-Instruct2025.12 | 1.42 |