List your company
ResearchFormerly WizWand

Reasoning on BRUMO 2025

60.83AccuracyDS-Qwen 14B
-2.433213.990930.41546.8391May 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DS-Qwen 14BModel Size=14B, 0-shot=true2025.0560.83
CATSModel Size=14B, 0-shot=true2025.0555
Layer-wise CapreseModel Size=14B, Sparse Algorithm=CATS, 0-shot=true2025.0553
E2E CapreseModel Size=14B, Sparse Algorithm=CATS, 0-shot=true2025.0549.17
E2E CapreseModel Size=7B, Sparse Algorithm=CATS, 0-shot=true2025.0547.5
DS-Qwen 7BModel Size=7B, 0-shot=true2025.0545.83
Layer-wise CapreseModel Size=14B, Sparse Algorithm=GRIFFIN, 0-shot=true2025.0543.33
E2E CapreseModel Size=14B, Sparse Algorithm=GRIFFIN, 0-shot=true2025.0540
Layer-wise CapreseModel Size=7B, Sparse Algorithm=CATS, 0-shot=true2025.0539.17
CATSModel Size=7B, 0-shot=true2025.0537.5
GRIFFINModel Size=14B, 0-shot=true2025.0533.33
E2E CapreseModel Size=7B, Sparse Algorithm=GRIFFIN, 0-shot=true2025.0529.17
Layer-wise CapreseModel Size=7B, Sparse Algorithm=GRIFFIN, 0-shot=true2025.0527.5
DS-Qwen 1.5BModel Size=1.5B, 0-shot=true2025.0525.83
GRIFFINModel Size=7B, 0-shot=true2025.0525
E2E CapreseModel Size=1.5B, Sparse Algorithm=CATS, 0-shot=true2025.0520
Layer-wise CapreseModel Size=1.5B, Sparse Algorithm=CATS, 0-shot=true2025.0513.33
CATSModel Size=1.5B, 0-shot=true2025.0510.83
E2E CapreseModel Size=1.5B, Sparse Algorithm=GRIFFIN, 0-shot=true2025.054.17
GRIFFINModel Size=1.5B, 0-shot=true2025.051.67
Layer-wise CapreseModel Size=1.5B, Sparse Algorithm=GRIFFIN, 0-shot=true2025.050