List your company
ResearchFormerly WizWand

Math on AIME 25 (Speedup, τ)

7.96SpeedupBASTION
2.25043.73275.2156.6973May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.057.969.43
BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.057.419.16
BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.057.18.81
BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.056.889.35
DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.056.457.26
DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.055.957.18
DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.054.134.97
DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.053.984.83
EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.053.132.51
EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.052.852.5
EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.052.52.16
EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.052.472.06