Uncertainty Calibration on RewardBench
0.009KuiperVerbalized
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VerbalizedModel Backbone=J1 LLAMA 8B2025.12 | 0.009 | 0.007 | |
| VerbalizedModel Backbone=QWEN 32B2025.12 | 0.023 | 0.027 | |
| ConsistencyModel Backbone=J1 LLAMA 70B2025.12 | 0.031 | 0.033 | |
| MajorityModel Backbone=J1 LLAMA 70B2025.12 | 0.031 | 0.031 | |
| VerbalizedModel Backbone=LLAMA 8B2025.12 | 0.032 | 0.038 | |
| ConsistencyModel Backbone=QWEN 32B2025.12 | 0.033 | 0.035 | |
| MajorityModel Backbone=QWEN 32B2025.12 | 0.034 | 0.035 | |
| VerbalizedModel Backbone=LLAMA 70B2025.12 | 0.035 | 0.045 | |
| MajorityModel Backbone=LLAMA 8B2025.12 | 0.035 | 0.059 | |
| ConsistencyModel Backbone=LLAMA 8B2025.12 | 0.039 | 0.071 | |
| ConsistencyModel Backbone=LLAMA 70B2025.12 | 0.039 | 0.052 | |
| MajorityModel Backbone=LLAMA 70B2025.12 | 0.04 | 0.041 | |
| VerbalizedModel Backbone=J1 QWEN 32B2025.12 | 0.041 | 0.043 | |
| ProbeModel Backbone=LLAMA 70B2025.12 | 0.065 | 0.067 | |
| VerbalizedModel Backbone=J1 LLAMA 70B2025.12 | 0.067 | 0.078 | |
| MajorityModel Backbone=J1 LLAMA 8B2025.12 | 0.076 | 0.075 | |
| ConsistencyModel Backbone=J1 LLAMA 8B2025.12 | 0.078 | 0.078 | |
| ProbeModel Backbone=QWEN 32B2025.12 | 0.092 | 0.106 | |
| ProbeModel Backbone=J1 QWEN 32B2025.12 | 0.111 | 0.128 | |
| ProbeModel Backbone=LLAMA 8B2025.12 | 0.12 | 0.145 | |
| ProbeModel Backbone=J1 LLAMA 70B2025.12 | 0.128 | 0.14 | |
| ProbeModel Backbone=J1 LLAMA 8B2025.12 | 0.166 | 0.19 | |
| MajorityModel Backbone=J1 QWEN 32B2025.12 | 0.232 | 0.249 | |
| ConsistencyModel Backbone=J1 QWEN 32B2025.12 | 0.234 | 0.251 |