Mathematical Reasoning on GSM8K PRO
95AccuracyDIN-ICL
Evaluation results
| Method | Links | |
|---|---|---|
| DIN-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 95 | |
| SET-BSRModel Series=Qwen-3, Parameters=32B2026.04 | 94.6 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 94 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=14B2026.04 | 93.2 | |
| SET-BSRModel Series=Gemma-3, Parameters=27B2026.04 | 93.1 | |
| DIN-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 93 | |
| DIN-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 92.8 | |
| DIN-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 92.7 | |
| SET-BSRModel Series=Qwen-3, Parameters=8B2026.04 | 92.2 | |
| SET-BSRModel Series=Gemma-3, Parameters=12B2026.04 | 92.1 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 92.1 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=32B2026.04 | 91.6 | |
| SET-BSRModel Series=Qwen-3, Parameters=14B2026.04 | 91.1 | |
| DIN-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 90.9 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 90.3 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=7B2026.04 | 89.2 | |
| DIN-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81.6 | |
| SET-BSRModel Series=LLaMA-3.1, Parameters=8B2026.04 | 80.4 |