Math Reasoning on GSM8K (Speedup and Tau)
5.15SpeedupDFlash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DFlashModel=Q3-4B, Temperature=0, Diffusion block size=162026.02 | 5.15 | 6.53 | |
| DFlashModel=Q3-8B, Temperature=0, Diffusion block size=162026.02 | 5.15 | 6.54 | |
| DFlashModel=Q3-4B, Temperature=1, Diffusion block size=162026.02 | 4.71 | 6 | |
| DFlashModel=Q3-8B, Temperature=1, Diffusion block size=162026.02 | 4.67 | 5.98 | |
| EAGLE-3Model=Q3-4B, Temperature=0, Draft tree size=602026.02 | 2.27 | 3.77 | |
| EAGLE-3Model=Q3-8B, Temperature=0, Draft tree size=602026.02 | 2.23 | 3.71 | |
| EAGLE-3Model=Q3-4B, Temperature=1, Draft tree size=602026.02 | 2.12 | 3.68 | |
| EAGLE-3Model=Q3-8B, Temperature=1, Draft tree size=602026.02 | 2.07 | 3.59 | |
| EAGLE-3Model=Q3-4B, Temperature=0, Draft tree size=162026.02 | 1.99 | 3.3 | |
| EAGLE-3Model=Q3-8B, Temperature=0, Draft tree size=162026.02 | 1.94 | 3.23 | |
| EAGLE-3Model=Q3-4B, Temperature=1, Draft tree size=162026.02 | 1.89 | 3.22 | |
| EAGLE-3Model=Q3-8B, Temperature=1, Draft tree size=162026.02 | 1.87 | 3.12 |