Reasoning on GPQA (Error %, ErrorGap %, STP %)
10.82Error Rate (%)G-PAC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| G-PACScoring method=Verbalized score, Alpha=0.05, Epsilon=0.152026.01 | 10.82 | 0 | 19.6 | |
| PACScoring method=Verbalized score, Alpha=0.05, Epsilon=0.152026.01 | 10.86 | 0 | 17.07 | |
| PACScoring method=Logits-based score, Alpha=0.05, Epsilon=0.152026.01 | 11.24 | 30 | 8.73 | |
| G-PACScoring method=Router-based score, Alpha=0.05, Epsilon=0.152026.01 | 11.34 | 0 | 30.54 | |
| PACScoring method=Router-based score, Alpha=0.05, Epsilon=0.152026.01 | 11.57 | 0 | 34.21 | |
| G-PACScoring method=Logits-based score, Alpha=0.05, Epsilon=0.152026.01 | 11.59 | 0 | 13.78 |