Mathematical Reasoning on MultiArith (Acc, #L, Acc/#L)
95AccuracyRuPLaR-Mix
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RuPLaR-Mix2026.05 | 95 | 2.03 | 46.8 | |
| RuPLaR-Gumbel2026.05 | 93.7 | 2.02 | 46.4 | |
| RuPLaRPrior Strength (alpha_kl)=0.32026.05 | 91.5 | 1.99 | 46 | |
| ReGuLaR2026.05 | 89.8 | 2.04 | 39.1 | |
| RuPLaR-Temp2026.05 | 89.8 | 2.04 | 44 | |
| RuPLaRLoss Component=w/o KL-Focus2026.05 | 89.5 | 2.06 | 43.4 | |
| RuPLaRPrior Strength (alpha_kl)=2.02026.05 | 89.2 | 2.01 | 44.4 | |
| RuPLaRLoss Component=w/o Problem-Thought2026.05 | 88.8 | 2.04 | 43.5 | |
| CoLaR-52026.05 | 86.4 | 3.21 | 26.9 | |
| RuPLaRPrior Type=Learned2026.05 | 82.3 | 2.07 | 39.8 | |
| RuPLaRPrior Type=Random2026.05 | 81 | 1.98 | 40.9 | |
| RuPLaRPrior Type=Uniform2026.05 | 72.2 | 2.03 | 35.6 | |
| COCONUT2026.05 | 41.1 | 6 | 6.85 | |
| iCoT2026.05 | 38.2 | 0 | — | |
| CODI2026.05 | 19.2 | 6 | 3.2 |