List your company
ResearchFormerly WizWand

Mathematical Reasoning on MATH500 (Pass@3)

76Pass@3 AccuracyT*
51.45657.82864.270.572Jan 16, 2026
Updated 8mo ago

Evaluation results

MethodLinks
T*Base model=SDAR-4B-Chat-b8, Block size=b82026.0176
TRACERLBase model=SDAR-4B-Chat-b4, Block size=b42026.0175.33
SDAR-4B-Chat-b4Method=Original Checkpoint, Block size=b42026.0168.67
T*Base model=SDAR-4B-Chat-b16, Block size=b162026.0164.53
T*Base model=SDAR-1.7B-Chat-b8, Block size=b82026.0163.4
TRACERLBase model=SDAR-1.7B-Chat-b4, Block size=b42026.0162.53
TRACERLBase model=SDAR-4B-Chat-b8, Block size=b82026.0162.1
SDAR-1.7B-Chat-b4Method=Original Checkpoint, Block size=b42026.0161.4
SDAR-4B-Chat-b8Method=Original Checkpoint, Block size=b82026.0160.73
TRACERLBase model=SDAR-4B-Chat-b16, Block size=b162026.0160.5
TRACERLBase model=SDAR-1.7B-Chat-b8, Block size=b82026.0160.2
T*Base model=SDAR-1.7B-Chat-b16, Block size=b162026.0159.8
T*Base model=SDAR-1.7B-Chat-b32, Block size=b322026.0159
SDAR-4B-Chat-b16Method=Original Checkpoint, Block size=b162026.0158.26
SDAR-1.7B-Chat-b8Method=Original Checkpoint, Block size=b82026.0155.9
TRACERLBase model=SDAR-1.7B-Chat-b16, Block size=b162026.0154.4
SDAR-1.7B-Chat-b32Method=Original Checkpoint, Block size=b322026.0154.2
TRACERLBase model=SDAR-1.7B-Chat-b32, Block size=b322026.0154.1
SDAR-1.7B-Chat-b16Method=Original Checkpoint, Block size=b162026.0152.4