Math Reasoning on MATH 500 (Speedup, tau)
6.09SpeedupDFlash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DFlashModel=Q3-4B, Temperature=0, Diffusion block size=162026.02 | 6.09 | 7.84 | |
| DFlashModel=Q3-8B, Temperature=0, Diffusion block size=162026.02 | 6.08 | 7.87 | |
| DFlashModel=Q3-4B, Temperature=1, Diffusion block size=162026.02 | 5.09 | 6.67 | |
| DFlashModel=Q3-8B, Temperature=1, Diffusion block size=162026.02 | 4.84 | 6.4 | |
| EAGLE-3Model=Q3-4B, Temperature=0, Draft tree size=602026.02 | 2.1 | 3.52 | |
| EAGLE-3Model=Q3-8B, Temperature=0, Draft tree size=602026.02 | 2.05 | 3.49 | |
| EAGLE-3Model=Q3-4B, Temperature=1, Draft tree size=602026.02 | 1.97 | 3.44 | |
| EAGLE-3Model=Q3-8B, Temperature=1, Draft tree size=602026.02 | 1.94 | 3.38 | |
| EAGLE-3Model=Q3-4B, Temperature=0, Draft tree size=162026.02 | 1.83 | 3.08 | |
| EAGLE-3Model=Q3-8B, Temperature=0, Draft tree size=162026.02 | 1.81 | 3.02 | |
| EAGLE-3Model=Q3-4B, Temperature=1, Draft tree size=162026.02 | 1.75 | 2.99 | |
| EAGLE-3Model=Q3-8B, Temperature=1, Draft tree size=162026.02 | 1.73 | 2.91 |