Mathematical Reasoning on GSM Hard (Accuracy, Line Count, Accuracy per Line)
10.8AccuracyRuPLaR-Mix
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RuPLaR-Mix2026.05 | 10.8 | 2.87 | 3.76 | |
| RuPLaR-Gumbel2026.05 | 10.2 | 2.88 | 3.54 | |
| RuPLaR-Temp2026.05 | 9.86 | 2.78 | 3.55 | |
| RuPLaRPrior Type=Learned2026.05 | 9.78 | 2.88 | 3.4 | |
| RuPLaRLoss Component=w/o Problem-Thought2026.05 | 9.7 | 2.76 | 3.51 | |
| RuPLaRPrior Strength (alpha_kl)=2.02026.05 | 9.47 | 2.87 | 3.3 | |
| RuPLaRLoss Component=w/o KL-Focus2026.05 | 9.4 | 2.76 | 3.41 | |
| RuPLaRPrior Strength (alpha_kl)=0.32026.05 | 9.33 | 2.62 | 3.56 | |
| ReGuLaR2026.05 | 8.27 | 4.12 | 2.01 | |
| RuPLaRPrior Type=Random2026.05 | 8.26 | 2.65 | 3.12 | |
| RuPLaRPrior Type=Uniform2026.05 | 8.04 | 3.24 | 2.48 | |
| CoLaR-52026.05 | 5.87 | 6.53 | 0.9 | |
| COCONUT2026.05 | 5.49 | 6 | 0.92 | |
| iCoT2026.05 | 3.87 | 0 | — | |
| CODI2026.05 | 2.97 | 6 | 0.5 |