Class-wise Calibration on MNIST
0.16CwECEOracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OracleBackbone=LeNet-52026.05 | 0.16 | — | |
| OracleBackbone=DenseNet402026.05 | 0.38 | — | |
| OracleBackbone=ResNet202026.05 | 0.39 | — | |
| ECLBackbone=ResNet202026.05 | 1.41 | 0.62 | |
| PseudoCalBackbone=ResNet202026.05 | 1.46 | — | |
| ECLBackbone=DenseNet402026.05 | 1.57 | 0.23 | |
| ECLBackbone=LeNet-52026.05 | 1.66 | -0.44 | |
| PseudoCalBackbone=DenseNet402026.05 | 1.77 | — | |
| PseudoCalBackbone=LeNet-52026.05 | 1.86 | — | |
| DRLBackbone=ResNet202026.05 | 1.94 | — | |
| TransCalBackbone=ResNet202026.05 | 2.47 | — | |
| DRLBackbone=DenseNet402026.05 | 2.81 | — | |
| TSBackbone=ResNet202026.05 | 3.06 | — | |
| DECEBackbone=ResNet202026.05 | 3.13 | — | |
| UncalBackbone=ResNet202026.05 | 3.14 | — | |
| KDEBackbone=ResNet202026.05 | 3.21 | — | |
| Soft-ECEBackbone=ResNet202026.05 | 3.23 | — | |
| DRLBackbone=LeNet-52026.05 | 3.79 | — | |
| TransCalBackbone=DenseNet402026.05 | 3.94 | — | |
| TSBackbone=DenseNet402026.05 | 4.46 | — | |
| DECEBackbone=DenseNet402026.05 | 4.51 | — | |
| KDEBackbone=DenseNet402026.05 | 4.66 | — | |
| UncalBackbone=DenseNet402026.05 | 4.69 | — | |
| Soft-ECEBackbone=DenseNet402026.05 | 4.74 | — | |
| TransCalBackbone=LeNet-52026.05 | 4.92 | — | |
| TSBackbone=LeNet-52026.05 | 5.18 | — | |
| DECEBackbone=LeNet-52026.05 | 5.31 | — | |
| UncalBackbone=LeNet-52026.05 | 5.41 | — | |
| KDEBackbone=LeNet-52026.05 | 5.49 | — | |
| Soft-ECEBackbone=LeNet-52026.05 | 5.54 | — |