Confidence Calibration on GPQA (test)
0.102ECEHTC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HTCVariant=Reduced2026.01 | 0.102 | 0.213 | 0.706 | |
| HTCVariant=Full2026.01 | 0.124 | 0.219 | 0.704 | |
| GlobalTrace-TPTemperature Scaling=true2026.01 | 0.136 | 0.257 | 0.643 | |
| LastStep-TPTemperature Scaling=true2026.01 | 0.139 | 0.258 | 0.61 | |
| GlobalTrace-TPTemperature Scaling=false2026.01 | 0.414 | 0.402 | 0.649 | |
| LastStep-TPTemperature Scaling=false2026.01 | 0.424 | 0.413 | 0.614 | |
| Verbalized Conf2026.01 | 0.454 | 0.523 | 0.593 |