Mathematical Reasoning on MATH 500 (Speedup, Length, Cost Share)
3.14SpeedupSpecBlock+adapt
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SpecBlock+adaptModel=Llama-3.1-8B, Temperature=02026.05 | 3.14 | 4.23 | 15 | |
| SpecBlock+OSDModel=Llama-3.1-8B, Temperature=02026.05 | 3.1 | 4.24 | 18 | |
| SpecBlockModel=Llama-3.1-8B, Temperature=02026.05 | 3.07 | 4.03 | 16 | |
| SpecBlock+adaptModel=Qwen3-8B, Temperature=1.02026.05 | 2.67 | 3.79 | 18 | |
| EAGLE-3Model=Llama-3.1-8B, Temperature=02026.05 | 2.66 | 5.93 | 31 | |
| SpecBlock+OSDModel=Qwen3-8B, Temperature=1.02026.05 | 2.64 | 3.83 | 19 | |
| SpecBlock+adaptModel=Qwen3-8B, Temperature=02026.05 | 2.61 | 3.9 | 17 | |
| SpecBlockModel=Qwen3-8B, Temperature=1.02026.05 | 2.6 | 3.63 | 14 | |
| SpecBlock+OSDModel=Qwen3-8B, Temperature=02026.05 | 2.57 | 3.92 | 19 | |
| SpecBlock+adaptModel=Qwen3-32B, Temperature=02026.05 | 2.55 | 3.73 | 13 | |
| SpecBlock+adaptModel=Qwen3-32B, Temperature=1.02026.05 | 2.55 | 3.64 | 13 | |
| SpecBlockModel=Qwen3-8B, Temperature=02026.05 | 2.53 | 3.71 | 14 | |
| SpecBlock+OSDModel=Qwen3-32B, Temperature=02026.05 | 2.51 | 3.72 | 15 | |
| SpecBlock+OSDModel=Qwen3-32B, Temperature=1.02026.05 | 2.51 | 3.67 | 14 | |
| SpecBlockModel=Qwen3-32B, Temperature=02026.05 | 2.48 | 3.53 | 11 | |
| SpecBlockModel=Qwen3-32B, Temperature=1.02026.05 | 2.48 | 3.48 | 11 | |
| FalconModel=Llama-3.1-8B, Temperature=02026.05 | 2.3 | 3.74 | 26 | |
| EAGLE-3Model=Qwen3-8B, Temperature=1.02026.05 | 2.18 | 4.28 | 29 | |
| EAGLE-3Model=Qwen3-32B, Temperature=1.02026.05 | 2.02 | 4.06 | 25 | |
| EAGLE-3Model=Qwen3-8B, Temperature=02026.05 | 1.94 | 4.46 | 29 | |
| ParallelSpecModel=Llama-3.1-8B, Temperature=02026.05 | 1.89 | 2.64 | 8 | |
| EAGLE-3Model=Qwen3-32B, Temperature=02026.05 | 1.82 | 4.27 | 24 | |
| SpecBlock+adaptModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.78 | 3.31 | 15 | |
| SpecBlock+OSDModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.77 | 3.38 | 17 | |
| SpecBlockModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.74 | 3.24 | 14 | |
| MedusaModel=Llama-3.1-8B, Temperature=02026.05 | 1.53 | 2.3 | 6 | |
| EAGLE-3Model=Llama-3.1-8B, Temperature=1.02026.05 | 1.32 | 4.31 | 30 | |
| SpSModel=Llama-3.1-8B, Temperature=02026.05 | 1.17 | 2.29 | 38 | |
| FalconModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.15 | 3.01 | 27 | |
| ParallelSpecModel=Llama-3.1-8B, Temperature=1.02026.05 | 0.97 | 2.18 | 9 | |
| MedusaModel=Llama-3.1-8B, Temperature=1.02026.05 | 0.83 | 1.9 | 7 | |
| SpSModel=Llama-3.1-8B, Temperature=1.02026.05 | 0.58 | 1.87 | 40 |