Top-label Confidence Calibration on SVHN
0.5ECEOracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OracleBackbone=ResNet202026.05 | 0.5 | — | |
| OracleBackbone=DenseNet402026.05 | 0.86 | — | |
| OracleBackbone=LeNet-52026.05 | 1.03 | — | |
| ECLBackbone=LeNet-52026.05 | 21.5 | 1.65 | |
| DRLBackbone=LeNet-52026.05 | 23.7 | — | |
| ECLBackbone=ResNet202026.05 | 36.8 | 2.12 | |
| ECLBackbone=DenseNet402026.05 | 38.4 | -1.15 | |
| DRLBackbone=ResNet202026.05 | 40.1 | — | |
| DRLBackbone=DenseNet402026.05 | 42 | — | |
| PseudoCalBackbone=ResNet202026.05 | 48.2 | — | |
| PseudoCalBackbone=LeNet-52026.05 | 52.4 | — | |
| TransCalBackbone=ResNet202026.05 | 59.4 | — | |
| DECEBackbone=LeNet-52026.05 | 60.8 | — | |
| TSBackbone=LeNet-52026.05 | 61.3 | — | |
| UncalBackbone=LeNet-52026.05 | 61.9 | — | |
| Soft-ECEBackbone=LeNet-52026.05 | 62.2 | — | |
| KDEBackbone=LeNet-52026.05 | 62.5 | — | |
| TransCalBackbone=LeNet-52026.05 | 63.7 | — | |
| PseudoCalBackbone=DenseNet402026.05 | 64.7 | — | |
| DECEBackbone=ResNet202026.05 | 66.9 | — | |
| Soft-ECEBackbone=ResNet202026.05 | 67.5 | — | |
| KDEBackbone=ResNet202026.05 | 67.8 | — | |
| TSBackbone=ResNet202026.05 | 68.1 | — | |
| UncalBackbone=ResNet202026.05 | 68.2 | — | |
| TransCalBackbone=DenseNet402026.05 | 72.9 | — | |
| TSBackbone=DenseNet402026.05 | 77.2 | — | |
| DECEBackbone=DenseNet402026.05 | 79.5 | — | |
| UncalBackbone=DenseNet402026.05 | 80.8 | — | |
| KDEBackbone=DenseNet402026.05 | 81.1 | — | |
| Soft-ECEBackbone=DenseNet402026.05 | 81.2 | — |