Reasoning on ZebraLogic
4.01Error Rate (%)G-PAC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| G-PACScoring method=Verbalized score, Alpha=0.05, Epsilon=0.082026.01 | 4.01 | 0 | 8.53 | |
| G-PACScoring method=Logits-based score, Alpha=0.05, Epsilon=0.082026.01 | 4.21 | 0 | 10.9 | |
| G-PACScoring method=Router-based score, Alpha=0.05, Epsilon=0.082026.01 | 4.35 | 0 | 34.32 | |
| PACScoring method=Verbalized score, Alpha=0.05, Epsilon=0.082026.01 | 4.76 | 3 | 4.97 | |
| PACScoring method=Logits-based score, Alpha=0.05, Epsilon=0.082026.01 | 6.04 | 10.3 | 27.65 | |
| PACScoring method=Router-based score, Alpha=0.05, Epsilon=0.082026.01 | 6.23 | 8.84 | 34.54 |