Calibration on USPS
1.54ECEOracle
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OracleBackbone=LeNet-52026.05 | 1.54 | — | — | |
| OracleBackbone=ResNet202026.05 | 2.23 | — | — | |
| OracleBackbone=DenseNet402026.05 | 2.54 | — | — | |
| Knowledge-Transferring-based Temperature ScalingIF=102023.04 | 4.55 | — | — | |
| ETSIF=102023.04 | 4.6 | — | — | |
| IROVAIF=102023.04 | 4.76 | — | — | |
| TSIF=102023.04 | 4.81 | — | — | |
| ECLBackbone=DenseNet402026.05 | 4.96 | -0.76 | — | |
| PseudoCalBackbone=ResNet202026.05 | 5.01 | — | — | |
| SBCIF=102023.04 | 5.12 | — | — | |
| ECLBackbone=ResNet202026.05 | 5.25 | 1.42 | — | |
| PseudoCalBackbone=DenseNet402026.05 | 5.34 | — | — | |
| GPCIF=102023.04 | 5.88 | — | — | |
| TS-IRIF=102023.04 | 6.59 | — | — | |
| IRIF=102023.04 | 6.98 | — | — | |
| DRLBackbone=DenseNet402026.05 | 7.92 | — | — | |
| DRLBackbone=ResNet202026.05 | 7.99 | — | — | |
| Knowledge-Transferring-based Temperature ScalingIF=502023.04 | 8.02 | — | — | |
| ECLBackbone=LeNet-52026.05 | 8.12 | -0.85 | — | |
| TSIF=502023.04 | 8.14 | — | — | |
| BaseIF=102023.04 | 8.29 | — | — | |
| TransCalBackbone=ResNet202026.05 | 8.36 | — | — | |
| Knowledge-Transferring-based Temperature ScalingIF=1002023.04 | 8.4 | — | — | |
| SBCIF=502023.04 | 8.57 | — | — | |
| PseudoCalBackbone=LeNet-52026.05 | 8.92 | — | — | |
| DECEBackbone=ResNet202026.05 | 9.05 | — | — | |
| TSBackbone=ResNet202026.05 | 9.12 | — | — | |
| UncalBackbone=ResNet202026.05 | 9.14 | — | — | |
| Soft-ECEBackbone=ResNet202026.05 | 9.32 | — | — | |
| KDEBackbone=ResNet202026.05 | 9.45 | — | — | |
| TSIF=1002023.04 | 9.52 | — | — | |
| SBCIF=1002023.04 | 10.1 | — | — | |
| IROVAIF=502023.04 | 10.54 | — | — | |
| IROVAIF=1002023.04 | 10.58 | — | — | |
| BaseIF=502023.04 | 11.21 | — | — | |
| GPCIF=502023.04 | 11.21 | — | — | |
| GPCIF=1002023.04 | 11.44 | — | — | |
| TS-IRIF=502023.04 | 11.89 | — | — | |
| IRIF=502023.04 | 11.91 | — | — | |
| TransCalBackbone=DenseNet402026.05 | 12.1 | — | — | |
| ETSIF=1002023.04 | 12.25 | — | — | |
| ETSIF=502023.04 | 12.81 | — | — | |
| TSBackbone=DenseNet402026.05 | 13.1 | — | — | |
| TS-IRIF=1002023.04 | 13.25 | — | — | |
| IRIF=1002023.04 | 13.62 | — | — | |
| BaseIF=1002023.04 | 15 | — | — | |
| DECEBackbone=DenseNet402026.05 | 15.3 | — | — | |
| DRLBackbone=LeNet-52026.05 | 15.5 | — | — | |
| UncalBackbone=DenseNet402026.05 | 15.7 | — | — | |
| KDEBackbone=DenseNet402026.05 | 15.8 | — | — | |
| Soft-ECEBackbone=DenseNet402026.05 | 15.9 | — | — | |
| TransCalBackbone=LeNet-52026.05 | 21.8 | — | — | |
| DECEBackbone=LeNet-52026.05 | 22.4 | — | — | |
| TSBackbone=LeNet-52026.05 | 22.7 | — | — | |
| KDEBackbone=LeNet-52026.05 | 22.8 | — | — | |
| UncalBackbone=LeNet-52026.05 | 22.9 | — | — | |
| Soft-ECEBackbone=LeNet-52026.05 | 23.1 | — | — | |
| ECLBackbone=LeNet-52026.05 | — | -0.33 | 2.11 | |
| ECLBackbone=ResNet202026.05 | — | 0.42 | 1.24 | |
| ECLBackbone=DenseNet402026.05 | — | -0.16 | 1.18 | |
| OracleBackbone=LeNet-52026.05 | — | — | 0.57 | |
| OracleBackbone=ResNet202026.05 | — | — | 0.63 | |
| OracleBackbone=DenseNet402026.05 | — | — | 0.72 | |
| UncalBackbone=LeNet-52026.05 | — | — | 6.87 |