Mathematical Reasoning on MATH500 (Accuracy, Friedman Rank, P(EDEN > competitor))
32.8AccuracyEDEN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EDENtotal number of branches explored=8402026.05 | 32.8 | 1.25 | 75 | |
| Majority-nn=52026.05 | 30.8 | 6.25 | 99 | |
| Diverse Beam Searchbeam width=3, total number of branches explored=12002026.05 | 30 | 4.75 | 96 | |
| Beam Searchbeam width=3, total number of branches explored=12002026.05 | 29.2 | 2.25 | 78 | |
| Best-of-nn=52026.05 | 28.2 | 4.62 | 96 | |
| Min-p Sampling2026.05 | 28 | 8 | 100 | |
| Greedy2026.05 | 27.4 | 6.12 | 99 | |
| Top-p Sampling2026.05 | 27.4 | 6.62 | 99 | |
| Top-H Sampling2026.05 | 26 | 8.12 | 100 | |
| Top-k Sampling2026.05 | 23 | 7 | 100 |