Mathematical Reasoning on GSM8K (Accuracy, Mean Questions, Mean Tokens)
96.6AccuracyQwen3-14B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-14BSetting=Baseline, Mode=(t)2026.05 | 96.6 | — | 2,699 | |
| Qwen3-14BSetting=Adaptive, Mode=(t)2026.05 | 96.6 | 0.1 | 533 | |
| Qwen3-4BSetting=Adaptive, Mode=(t)2026.05 | 96.1 | 0 | 568 | |
| Qwen3-14BSetting=Baseline, Mode=(nt)2026.05 | 96 | — | 192 | |
| Olmo-3-7B-ThinkSetting=Fixed, Mode=(t)2026.05 | 95.7 | 0.3 | 10,103 | |
| Olmo-3-7B-ThinkSetting=Adaptive, Mode=(t)2026.05 | 95.5 | 0 | 2,087 | |
| Qwen3-14BSetting=Adaptive, Mode=(nt)2026.05 | 95.4 | 0 | 200 | |
| Qwen3-4BSetting=Baseline, Mode=(t)2026.05 | 95.2 | — | 2,327 | |
| Qwen3-14BSetting=Fixed, Mode=(nt)2026.05 | 95.2 | 0.1 | 1,115 | |
| Olmo-3-7B-ThinkSetting=Baseline, Mode=(t)2026.05 | 94.9 | — | 2,066 | |
| Qwen3-4BSetting=Adaptive, Mode=(nt)2026.05 | 93.1 | 0 | 296 | |
| Qwen3-4BSetting=Fixed, Mode=(nt)2026.05 | 92.6 | 0 | 1,374 | |
| Qwen3-1.7BSetting=Adaptive, Mode=(t)2026.05 | 91.6 | 0.1 | 840 | |
| Qwen3-1.7BSetting=Baseline, Mode=(t)2026.05 | 91.4 | — | 1,380 | |
| Qwen3-4BSetting=Baseline, Mode=(nt)2026.05 | 90.6 | — | 270 | |
| Qwen3-1.7BSetting=Adaptive, Mode=(nt)2026.05 | 86.1 | 0.1 | 318 | |
| Qwen3-1.7BSetting=Baseline, Mode=(nt)2026.05 | 84.9 | — | 265 | |
| Qwen3-1.7BSetting=Fixed, Mode=(nt)2026.05 | 84.3 | 0.3 | 1,356 |