Top-label Confidence Calibration on MNIST
0.21ECEOracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OracleBackbone=LeNet-52026.05 | 0.21 | -32 | |
| OracleBackbone=LeNet-52026.05 | 0.3 | — | |
| ECLBackbone=ResNet202026.05 | 1.29 | 54 | |
| OracleBackbone=DenseNet402026.05 | 1.4 | — | |
| ECLBackbone=DenseNet402026.05 | 1.42 | 19 | |
| OracleBackbone=ResNet202026.05 | 1.54 | — | |
| ECLBackbone=LeNet-52026.05 | 1.58 | -32 | |
| PseudoCalBackbone=LeNet-52026.05 | 1.77 | -32 | |
| DRLBackbone=LeNet-52026.05 | 3.52 | -32 | |
| TransCalBackbone=LeNet-52026.05 | 4.68 | -32 | |
| TSBackbone=LeNet-52026.05 | 4.92 | -32 | |
| DECEBackbone=LeNet-52026.05 | 5.07 | -32 | |
| UncalBackbone=LeNet-52026.05 | 5.16 | -32 | |
| Soft-ECEBackbone=LeNet-52026.05 | 5.19 | -32 | |
| KDEBackbone=LeNet-52026.05 | 5.19 | -32 | |
| ECLBackbone=ResNet202026.05 | 7.88 | 1.25 | |
| PseudoCalBackbone=ResNet202026.05 | 8.22 | — | |
| ECLBackbone=LeNet-52026.05 | 8.52 | -0.92 | |
| PseudoCalBackbone=LeNet-52026.05 | 9.08 | — | |
| ECLBackbone=DenseNet402026.05 | 9.15 | 0.68 | |
| PseudoCalBackbone=DenseNet402026.05 | 9.72 | — | |
| DRLBackbone=ResNet202026.05 | 10.2 | — | |
| TransCalBackbone=ResNet202026.05 | 13.1 | — | |
| DRLBackbone=DenseNet402026.05 | 14.8 | — | |
| TSBackbone=ResNet202026.05 | 15.3 | — | |
| DECEBackbone=ResNet202026.05 | 15.8 | — | |
| KDEBackbone=ResNet202026.05 | 16.1 | — | |
| UncalBackbone=ResNet202026.05 | 16.2 | — | |
| Soft-ECEBackbone=ResNet202026.05 | 16.5 | — | |
| TransCalBackbone=DenseNet402026.05 | 19.8 | — | |
| TSBackbone=DenseNet402026.05 | 21.6 | — | |
| DECEBackbone=DenseNet402026.05 | 22.1 | — | |
| DRLBackbone=LeNet-52026.05 | 22.3 | — | |
| KDEBackbone=DenseNet402026.05 | 22.9 | — | |
| UncalBackbone=DenseNet402026.05 | 23.4 | — | |
| Soft-ECEBackbone=DenseNet402026.05 | 23.6 | — | |
| DECEBackbone=LeNet-52026.05 | 26.5 | — | |
| TransCalBackbone=LeNet-52026.05 | 26.9 | — | |
| UncalBackbone=LeNet-52026.05 | 27.3 | — | |
| TSBackbone=LeNet-52026.05 | 27.7 | — | |
| Soft-ECEBackbone=LeNet-52026.05 | 27.8 | — | |
| KDEBackbone=LeNet-52026.05 | 27.9 | — |