List your company
ResearchFormerly WizWand

Math on MATH500 (Speedup, τ)

8.5SpeedupBASTION
2.524.07255.6257.1775May 28, 2026Jun 3, 2026Jun 10, 2026Jun 17, 2026Jun 23, 2026Jun 30, 2026Jul 7, 2026
Updated 3mo ago

Evaluation results

MethodLinks
BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.058.510.15
BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.058.0510.2
BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.058.0210.21
BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.057.5910.2
DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.056.967.79
DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.056.867.93
DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.055.596.6
DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.055.436.45
DFlash-TfMTemperature=0.0, Reasoning Mode=Reasoning, Path=Tree, Budget=642026.075.311.05
DFlash-TfMTemperature=0.0, Reasoning Mode=No Reasoning, Path=Tree, Budget=642026.075.1411.06
EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.053.042.54
EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.053.032.41
EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.052.832.48
EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.052.752.35