Mathematical Reasoning on MultiArith (Acc, RL, SL, RE, SE)
100AccuracyVanilla
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Vanilla2026.03 | 100 | 997 | 1,181 | 10.03 | 8.47 | |
| EAT2026.03 | 100 | 958 | 1,142 | 10.44 | 8.76 | |
| Vanilla2026.03 | 100 | — | 1,181 | — | 8.47 | |
| EAT2026.03 | 100 | — | 1,142 | — | 8.76 | |
| ROMCSC2026.03 | 99.2 | 469 | 616 | 21.15 | 16.1 | |
| ROM_CSCCounterfactual Self-Correction=true2026.03 | 99.2 | — | 616 | — | 16.1 | |
| Cut5122026.03 | 98.33 | 512 | 1,179 | 19.21 | 8.34 | |
| Cut512max tokens=5122026.03 | 98.33 | — | 1,179 | — | 8.34 | |
| ROM2026.03 | 98.3 | 613 | 768 | 16.04 | 12.8 | |
| ROM2026.03 | 98.3 | — | 768 | — | 12.8 | |
| L12026.03 | 97.5 | 758 | 930 | 12.86 | 10.48 | |
| Cut20482026.03 | 97.5 | 934 | 1,179 | 10.44 | 8.27 | |
| Cut10242026.03 | 97.5 | 824 | 1,179 | 11.83 | 8.27 | |
| L12026.03 | 97.5 | — | 930 | — | 10.48 | |
| Cut2048max tokens=20482026.03 | 97.5 | — | 1,179 | — | 8.27 | |
| Cut1024max tokens=10242026.03 | 97.5 | — | 1,179 | — | 8.27 |