Mathematical Reasoning on GSM+ (Accuracy)
62.29Accuracy (GSM+)Qwen-2.5-3B-instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen-2.5-3B-instruct2025.07 | 62.29 | |
| BBoxERBase Model=Qwen-2.5-3B-instruct, Budget (b)=150, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.07 | 62.27 | |
| BBoxERBase Model=Qwen-2.5-3B-instruct, Budget (b)=300, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.07 | 61.94 | |
| BBoxERBase Model=Llama3.1-8B-Instruct, Budget (b)=300, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.07 | 55.33 | |
| BBoxERBase Model=Llama3.1-8B-Instruct, Budget (b)=150, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.07 | 55.11 | |
| Llama3.1-8B-Instruct2025.07 | 54.37 | |
| MobileMoE-LN_act=922M, N_total=5.3B2026.05 | 50.2 | |
| Qwen3.5 2BN_act=1.9B, N_total=1.9B2026.05 | 42.4 | |
| MobileMoE-MN_act=528M, N_total=2.8B2026.05 | 42.3 | |
| BBoxERBase Model=Llama3.1-8B, Budget (b)=300, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.07 | 37.88 | |
| BBoxERBase Model=Llama3.1-8B, Budget (b)=150, Optimization Algorithm=D-CMA, Update Type=normalization layers2025.07 | 37.28 | |
| Llama3.1-8B2025.07 | 36.5 | |
| MobileMoE-SN_act=272M, N_total=1.3B2026.05 | 28.9 | |
| OLMoE-1B-7BN_act=1.3B, N_total=6.9B2026.05 | 28.1 | |
| Llama 3.2 1BN_act=1.2B, N_total=1.2B2026.05 | 27.8 | |
| SmolLM2 1.7BN_act=1.7B, N_total=1.7B2026.05 | 26.6 | |
| Qwen3.5 0.8BN_act=749M, N_total=749M2026.05 | 26.5 | |
| Gemma 3 1BN_act=1.0B, N_total=1.0B2026.05 | 25.2 | |
| OLMo 2 1BN_act=1.5B, N_total=1.5B2026.05 | 25.1 | |
| MobileLLM-ProN_act=1.1B, N_total=1.1B2026.05 | 17 | |
| SmolLM2 360MN_act=362M, N_total=362M2026.05 | 4.6 | |
| Gemma 3 270MN_act=270M, N_total=270M2026.05 | 4.3 |