Mathematical Reasoning on FOLIO to GSM8K
95.1AccuracyDIN-ICL
Evaluation results
| Method | Links | |
|---|---|---|
| DIN-ICLModel Series=Gemma-3, Parameters=27B2026.04 | 95.1 | |
| DIN-ICLModel Series=Qwen-3, Parameters=32B2026.04 | 95 | |
| SET-BSRModel Series=Qwen-3, Parameters=32B2026.04 | 94.6 | |
| DIN-ICLModel Series=Qwen-3, Parameters=8B2026.04 | 94.6 | |
| DIN-ICLModel Series=Gemma-3, Parameters=12B2026.04 | 93.7 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=14B2026.04 | 93.4 | |
| SET-BSRModel Series=Qwen-3, Parameters=8B2026.04 | 93.1 | |
| SET-BSRModel Series=Gemma-3, Parameters=27B2026.04 | 93.1 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=14B2026.04 | 92.9 | |
| SET-BSRModel Series=Gemma-3, Parameters=12B2026.04 | 92.6 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=32B2026.04 | 92.1 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=32B2026.04 | 91.6 | |
| DIN-ICLModel Series=Qwen-3, Parameters=14B2026.04 | 91 | |
| SET-BSRModel Series=Qwen-3, Parameters=14B2026.04 | 89.9 | |
| DIN-ICLModel Series=Qwen-2.5, Parameters=7B2026.04 | 89.7 | |
| SET-BSRModel Series=Qwen-2.5, Parameters=7B2026.04 | 89.6 | |
| DIN-ICLModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81.5 | |
| SET-BSRModel Series=LLaMA-3.1, Parameters=8B2026.04 | 81.4 |