Reasoning on GSM PRO
100AccuracyZERO-SHOT
Evaluation results
| Method | Links | |
|---|---|---|
| ZERO-SHOTModel Series=Qwen-3, Parameters=8B2026.04 | 100 | |
| ZERO-SHOTModel Series=Qwen-3, Parameters=32B2026.04 | 100 | |
| X-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 100 | |
| DIN-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 100 | |
| DIN-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 100 | |
| SET-BSRModel Series=Qwen-3, Parameters=32B2026.04 | 100 | |
| DIN-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 100 | |
| DIN-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 100 | |
| ZERO-SHOTModel Series=Qwen-2.5, Parameters=32B2026.04 | 99.8 | |
| X-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 99.6 | |
| X-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 99.6 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 99.6 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=32B2026.04 | 99.6 | |
| SET-BSRModel Series=Qwen-3, Parameters=8B2026.04 | 99.6 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 99.6 | |
| DIN-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 99.2 | |
| DIN-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 99.2 | |
| DIN-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 99 | |
| DIN-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 99 | |
| ZERO-SHOTModel Series=Gemma-3, Parameters=12B2026.04 | 98.8 | |
| ZERO-SHOTModel Series=Gemma-3, Parameters=27B2026.04 | 98.2 | |
| X-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 97.8 | |
| SET-BSRModel Series=Gemma-3, Parameters=12B2026.04 | 97.8 | |
| X-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 97.6 | |
| SET-BSRModel Series=Gemma-3, Parameters=27B2026.04 | 97.6 | |
| DIN-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 97 | |
| DIN-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 97 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 96.8 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 96.8 | |
| ZERO-SHOTModel Series=Qwen-3, Parameters=14B2026.04 | 96.2 | |
| ZERO-SHOTModel Series=Qwen-2.5, Parameters=7B2026.04 | 95.6 | |
| X-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 95.4 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=7B2026.04 | 95.4 | |
| DIN-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 95 | |
| X-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 94.8 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 94.8 | |
| SET-BSRModel Series=Qwen-3, Parameters=14B2026.04 | 94.8 | |
| ZERO-SHOTModel Series=Qwen-3, Parameters=32B2026.04 | 94.6 | |
| ZERO-SHOTModel Series=Gemma-3, Parameters=27B2026.04 | 94.6 | |
| X-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 94.6 | |
| ZERO-SHOTModel Series=Qwen-2.5, Parameters=14B2026.04 | 94.3 | |
| X-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 94.2 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=14B2026.04 | 94.2 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 94 | |
| DIN-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 93.9 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 93.9 | |
| ZERO-SHOTModel Series=Gemma-3, Parameters=12B2026.04 | 93.2 | |
| X-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 93.2 | |
| X-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 93.1 | |
| DIN-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 93 | |
| DIN-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 92.7 | |
| ZERO-SHOTModel Series=Qwen-3, Parameters=8B2026.04 | 92.4 | |
| X-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 92.2 | |
| X-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 92.1 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 92.1 | |
| ZERO-SHOTModel Series=Qwen-2.5, Parameters=14B2026.04 | 91.8 | |
| ZERO-SHOTModel Series=Qwen-2.5, Parameters=32B2026.04 | 91.7 | |
| X-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 91.6 | |
| DIN-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 91.2 | |
| X-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 91.1 | |
| ZERO-SHOTModel Series=Qwen-3, Parameters=14B2026.04 | 90.5 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 90.3 | |
| ZERO-SHOTModel Series=Qwen-2.5, Parameters=7B2026.04 | 89.9 | |
| X-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 89.2 | |
| ZERO-SHOTModel Series=LLaMA-3.1, Parameters=8B2026.04 | 88.8 | |
| DIN-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 88.6 | |
| DIN-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 88.6 | |
| ZERO-SHOTModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81.7 | |
| DIN-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81.6 | |
| X-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81 | |
| SET-BSRModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81 | |
| X-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 80.4 |