Honesty Alignment on HonestyBench OOD
81.19Squad ScoreCal-Only
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Cal-OnlyCategory=Upper Bound, Amount of annotated data=560k, Base Model=Qwen2.5-7B-Instruct2025.10 | 81.19 | 81.3 | 80.45 | 79.58 | 92.11 | 85.75 | |
| EliCalCategory=Upper Bound, Amount of annotated data=560k, Base Model=Qwen2.5-7B-Instruct2025.10 | 81.04 | 81.1 | 81.02 | 80.68 | 92.11 | 85.83 | |
| EliCalCategory=Training-based, Amount of annotated data=1k, Base Model=Qwen2.5-7B-Instruct2025.10 | 78.48 | 80.11 | 79.85 | 78.09 | 91.74 | 84.47 | |
| Verbal-10Category=Training-free, Base Model=Qwen2.5-7B-Instruct2025.10 | 72.54 | 68.2 | 63.25 | 64.44 | 73.4 | 71.05 | |
| Cal-OnlyCategory=Training-based, Amount of annotated data=1k, Base Model=Qwen2.5-7B-Instruct2025.10 | 71.59 | 71.48 | 69.33 | 66.96 | 86.13 | 77.32 | |
| DACACategory=Training-based, Base Model=Qwen2.5-7B-Instruct2025.10 | 66.79 | 65.71 | 62.62 | 73.98 | 76.4 | 70.98 | |
| Consis-SemCategory=Training-free, Base Model=Qwen2.5-7B-Instruct2025.10 | 66.16 | 76.26 | 77.5 | 70.76 | 70.44 | 70.2 | |
| Verbal-0Category=Training-free, Base Model=Qwen2.5-7B-Instruct2025.10 | 65.76 | 70.41 | 59.56 | 60.54 | 70.64 | 67.12 | |
| Consis-LexCategory=Training-free, Base Model=Qwen2.5-7B-Instruct2025.10 | 62.12 | 65.43 | 72.59 | 61.07 | 77.07 | 69.87 | |
| N-ProbCategory=Training-free, Base Model=Qwen2.5-7B-Instruct2025.10 | 60.72 | 66.06 | 70.51 | 65.93 | 74.73 | 68.58 | |
| Eli-OnlyCategory=Training-based, Base Model=Qwen2.5-7B-Instruct2025.10 | 60.66 | 76.61 | 74.77 | 66.56 | 74.6 | 69.66 | |
| ThermometerCategory=Training-based, Base Model=Qwen2.5-7B-Instruct2025.10 | 60.23 | 62.9 | 56.98 | 61.9 | 68.76 | 63.88 | |
| ProbCategory=Training-free, Base Model=Qwen2.5-7B-Instruct2025.10 | 56.63 | 61.3 | 68.34 | 61.85 | 71.3 | 64.94 |