Confidence Calibration on SimpleQA (test)
6.8ECEHTC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HTCVariant=Reduced2026.01 | 6.8 | 14 | 75.2 | |
| LastStep-TPTemperature Scaling=true2026.01 | 7.1 | 17.8 | 69.8 | |
| HTCVariant=Full2026.01 | 7.5 | 15 | 72.7 | |
| GlobalTrace-TPTemperature Scaling=true2026.01 | 7.7 | 18.1 | 69.1 | |
| LastStep-TPTemperature Scaling=false2026.01 | 10.1 | 18.6 | 69.9 | |
| GlobalTrace-TPTemperature Scaling=false2026.01 | 11 | 19.3 | 69.2 | |
| Verbalized Conf2026.01 | 12.1 | 19.6 | 65.5 |