Preference Evaluation on PPE Preference (test)
0.0434Kuiper StatisticProbe
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProbeModel=LLAMA Scout (109B)2025.12 | 0.0434 | 5.82 | |
| VerbalizedModel=LLAMA Scout (109B)2025.12 | 0.1179 | 8.92 | |
| ProbeModel=GPT-OSS 20B2025.12 | 0.1461 | 17.13 | |
| ConsistencyModel=GPT-OSS 20B, N=10, temperature=0.72025.12 | 0.2045 | 19.22 | |
| MajorityModel=GPT-OSS 20B, N=10, temperature=0.72025.12 | 0.2056 | 19.34 | |
| VerbalizedModel=GPT-OSS 20B2025.12 | 0.2265 | 22.33 | |
| MajorityModel=LLAMA Scout (109B), N=10, temperature=0.72025.12 | 0.3506 | 32.46 | |
| ConsistencyModel=LLAMA Scout (109B), N=10, temperature=0.72025.12 | 0.3533 | 32.87 |