Mathematical Reasoning on GSM8K (Accuracy, Friedman Rank, P(EDEN))
81.5AccuracyBeam Search
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Beam Searchbeam width=3, total number of branches explored=12002026.05 | 81.5 | 2.25 | 0.78 | |
| EDENtotal number of branches explored=5982026.05 | 80.5 | 1.25 | 0.75 | |
| Majority-nn=52026.05 | 78.7 | 6.25 | 0.99 | |
| Best-of-nn=52026.05 | 78.2 | 4.62 | 0.96 | |
| Diverse Beam Searchbeam width=3, total number of branches explored=12002026.05 | 77.5 | 4.75 | 0.96 | |
| Greedy2026.05 | 73.5 | 6.12 | 0.99 | |
| Top-p Sampling2026.05 | 73.5 | 6.62 | 0.99 | |
| Min-p Sampling2026.05 | 72.3 | 8 | 1 | |
| Top-k Sampling2026.05 | 70.7 | 7 | 1 | |
| Top-H Sampling2026.05 | 69.7 | 8.12 | 1 |