Math on GSM8K (Speedup and τ)
8.08SpeedupBASTION
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.05 | 8.08 | 8.78 | |
| BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.05 | 7.64 | 9.02 | |
| BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.05 | 7.48 | 8.98 | |
| BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.05 | 7.26 | 8.91 | |
| DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.05 | 5.87 | 6.55 | |
| DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.05 | 5.83 | 6.51 | |
| DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.05 | 5.55 | 5.98 | |
| DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.05 | 5.09 | 5.82 | |
| DFlash-TfMTemperature=1.0, Reasoning Mode=Reasoning, Path=Tree, Budget=642026.07 | 4.85 | 10.63 | |
| DFlash-TfMTemperature=0.0, Reasoning Mode=No Reasoning, Path=Tree, Budget=642026.07 | 4.65 | 10.56 | |
| EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.05 | 3.39 | 2.75 | |
| EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.05 | 3.23 | 2.8 | |
| EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.05 | 3.22 | 2.61 | |
| EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.05 | 3.16 | 2.69 |