Mathematical Reasoning on OlympiadBench (ECE, Brier score)
7ECEProbe
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProbeN=12026.03 | 7 | 25.43 | |
| MSV 64N=642026.03 | 8.03 | 26.13 | |
| MSV 1N=12026.03 | 8.06 | 26.2 | |
| MSV 4N=42026.03 | 10.31 | 28.64 | |
| MSV 16N=162026.03 | 10.59 | 28.59 | |
| ProbeN=42026.03 | 15.1 | 33.76 | |
| MSV 1N=42026.03 | 16.75 | 36.24 | |
| Probe + WV 64N=642026.03 | 17.36 | 41.02 | |
| MSV 1 + WV 64N=642026.03 | 17.69 | 42.19 | |
| MSV 1 + WV 16N=162026.03 | 20.49 | 44.76 | |
| Probe + WV 16N=162026.03 | 20.73 | 44.05 | |
| ProbeN=162026.03 | 22.94 | 44.28 | |
| MSV 1N=162026.03 | 25.19 | 48.3 | |
| MSV 1 + WV 4N=42026.03 | 30.44 | 56.42 | |
| ProbeN=642026.03 | 30.48 | 55.2 | |
| Probe + WV 4N=42026.03 | 30.66 | 56.6 | |
| MSV 1N=642026.03 | 35.55 | 64.53 |