Calibration on CIFAR-100 (test)
0.85ECEDPS
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DPSBackbone=WideResNet-40-1, Hyperparameters=gamma = 0.97, c = 20002025.12 | 0.85 | — | — | — | — | 72.34 | 0.18 | 0.87 | — | — | — | |
| KD + MDCABackbone=WideResNet-40-12025.12 | 0.98 | — | — | — | — | 71.07 | 0.2 | 1.1 | — | — | — | |
| KD + AdaFocalBackbone=WideResNet-40-12025.12 | 1.19 | — | — | — | — | 71.7 | 0.19 | 1.34 | — | — | — | |
| KD + MixUpBackbone=WideResNet-40-12025.12 | 1.21 | — | — | — | — | 72.48 | 0.2 | 1.17 | — | — | — | |
| FLSDBackbone=DenseNet, Temperature Scaling=Post T2025.03 | 1.3 | — | — | — | — | — | — | — | — | — | — | |
| LSBackbone=WideResNet-40-12025.12 | 1.3 | — | — | — | — | 70.07 | 0.21 | 1.49 | — | — | — | |
| FL+AUCOCLLoss function=FL+AUCOCL, Post temperature scaling=true2023.08 | 1.34 | — | 0.95 | 30.24 | 17.5 | — | — | — | — | — | — | |
| MDCABackbone=WideResNet-40-12025.12 | 1.35 | — | — | — | — | 68.51 | 0.21 | 1.34 | — | — | — | |
| AdaFL53Loss function=AdaFL53, Post temperature scaling=true2023.08 | 1.47 | — | 1.22 | 31.3 | 18.3 | — | — | — | — | — | — | |
| BSCE-GRABackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 1.59 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=ResNet50, Temperature Scaling=Post T2025.03 | 1.59 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=DenseNet, Temperature Scaling=Post T2025.03 | 1.61 | — | — | — | — | — | — | — | — | — | — | |
| BSCEBackbone=DenseNet, Temperature Scaling=Post T2025.03 | 1.62 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=DenseNet, Temperature Scaling=Pre T2025.03 | 1.62 | — | — | — | — | — | — | — | — | — | — | |
| BSCEBackbone=DenseNet, Temperature Scaling=Pre T2025.03 | 1.63 | — | — | — | — | — | — | — | — | — | — | |
| CE+AUCOCLLoss function=CE+AUCOCL, Post temperature scaling=true2023.08 | 1.65 | — | 0.75 | 29.78 | 18.4 | — | — | — | — | — | — | |
| FL+S-ECELoss function=FL+S-ECE, Post temperature scaling=true2023.08 | 1.74 | — | 1.56 | 32.19 | 18 | — | — | — | — | — | — | |
| FL+S-AvUCLoss function=FL+S-AvUC, Post temperature scaling=true2023.08 | 1.83 | — | 0.53 | 31.74 | 17.7 | — | — | — | — | — | — | |
| DFLBackbone=DenseNet, Temperature Scaling=Post T2025.03 | 1.83 | — | — | — | — | — | — | — | — | — | — | |
| BSCEBackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 1.9 | — | — | — | — | — | — | — | — | — | — | |
| BSCEBackbone=ResNet50, Temperature Scaling=Post T2025.03 | 1.9 | — | — | — | — | — | — | — | — | — | — | |
| FL (γ=3)Loss function=FL (γ=3), Post temperature scaling=true2023.08 | 1.92 | — | 1.46 | 31.16 | 18.4 | — | — | — | — | — | — | |
| FL+MMCELoss function=FL+MMCE, Post temperature scaling=true2023.08 | 1.92 | — | 1.82 | 31.24 | 18.1 | — | — | — | — | — | — | |
| KD + MMCEBackbone=WideResNet-40-12025.12 | 2.02 | — | — | — | — | 72.08 | 0.19 | 1.95 | — | — | — | |
| AdaFocalBackbone=WideResNet-40-12025.12 | 2.1 | — | — | — | — | 67.36 | 0.21 | 1.97 | — | — | — | |
| CE+MMCELoss function=CE+MMCE, Post temperature scaling=true2023.08 | 2.32 | — | 1.23 | 34.6 | 20.9 | — | — | — | — | — | — | |
| CELoss function=CE, Post temperature scaling=true2023.08 | 2.41 | — | 1.1 | 33.91 | 21.1 | — | — | — | — | — | — | |
| BSCEBackbone=WideResNet, Temperature Scaling=Post T2025.03 | 2.42 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 2.46 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=WideResNet, Temperature Scaling=Post T2025.03 | 2.46 | — | — | — | — | — | — | — | — | — | — | |
| DFLBackbone=WideResNet, Temperature Scaling=Post T2025.03 | 2.52 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=ResNet110, Temperature Scaling=Pre T2025.03 | 2.53 | — | — | — | — | — | — | — | — | — | — | |
| BSCE-GRABackbone=ResNet110, Temperature Scaling=Post T2025.03 | 2.53 | — | — | — | — | — | — | — | — | — | — | |
| DFLBackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 2.54 | — | — | — | — | — | — | — | — | — | — | |
| DFLBackbone=ResNet50, Temperature Scaling=Post T2025.03 | 2.56 | — | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=ResNet50, Temperature Scaling=Post T2025.03 | 2.57 | — | — | — | — | — | — | — | — | — | — | |
| TSBackbone=WideResNet-40-12025.12 | 2.57 | — | — | — | — | 70.04 | 0.19 | 2.5 | — | — | — | |
| MixUpBackbone=WideResNet-40-12025.12 | 2.57 | — | — | — | — | 72.04 | 0.21 | 2.52 | — | — | — | |
| BSCEBackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 2.63 | — | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 2.7 | — | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=WideResNet, Temperature Scaling=Post T2025.03 | 2.71 | — | — | — | — | — | — | — | — | — | — | |
| BSCEBackbone=ResNet110, Temperature Scaling=Pre T2025.03 | 2.75 | — | — | — | — | — | — | — | — | — | — | |
| BSCEBackbone=ResNet110, Temperature Scaling=Post T2025.03 | 2.75 | — | — | — | — | — | — | — | — | — | — | |
| MMCEBackbone=DenseNet, Temperature Scaling=Post T2025.03 | 2.87 | — | — | — | — | — | — | — | — | — | — | |
| MMCEBackbone=WideResNet, Temperature Scaling=Post T2025.03 | 2.99 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=DenseNet, Temperature Scaling=Post T2025.03 | 2.99 | — | — | — | — | — | — | — | — | — | — | |
| CEBackbone=ResNet50, Temperature Scaling=Post T2025.03 | 3.05 | — | — | — | — | — | — | — | — | — | — | |
| MaCSBackbone=ResNet-502026.03 | 3.13 | — | — | — | — | — | — | — | 1.31 | — | — | |
| Label SmoothingBackbone=ResNet-502026.03 | 3.14 | — | — | — | — | — | — | — | 1.576 | — | — | |
| CE+S-AvUCLoss function=CE+S-AvUC, Post temperature scaling=true2023.08 | 3.23 | — | 0.53 | 31.71 | 19.9 | — | — | — | — | — | — | |
| CEBackbone=WideResNet, Temperature Scaling=Post T2025.03 | 3.27 | — | — | — | — | — | — | — | — | — | — | |
| DPSBackbone=WideResNet-40-1, Hyperparameters=gamma = 0.96, c = 30002025.12 | 3.28 | — | — | — | — | 72.62 | 0.19 | 3.19 | — | — | — | |
| MMCEBackbone=ResNet50, Temperature Scaling=Post T2025.03 | 3.32 | — | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=DenseNet, Temperature Scaling=Pre T2025.03 | 3.38 | — | — | — | — | — | — | — | — | — | — | |
| CEBackbone=DenseNet, Temperature Scaling=Post T2025.03 | 3.43 | — | — | — | — | — | — | — | — | — | — | |
| DFLBackbone=ResNet110, Temperature Scaling=Pre T2025.03 | 3.47 | — | — | — | — | — | — | — | — | — | — | |
| DFLBackbone=ResNet110, Temperature Scaling=Post T2025.03 | 3.47 | — | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=ResNet110, Temperature Scaling=Post T2025.03 | 3.71 | — | — | — | — | — | — | — | — | — | — | |
| PS-KDBackbone=WideResNet-40-12025.12 | 3.73 | — | — | — | — | 72.56 | 0.2 | 3.72 | — | — | — | |
| CE+S-ECELoss function=CE+S-ECE, Post temperature scaling=true2023.08 | 3.85 | — | 1.3 | 31.85 | 19.7 | — | — | — | — | — | — | |
| MMCEBackbone=ResNet110, Temperature Scaling=Post T2025.03 | 3.93 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=ResNet50, Temperature Scaling=Post T2025.03 | 4.27 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=ResNet110, Temperature Scaling=Post T2025.03 | 4.3 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=WideResNet, Temperature Scaling=Post T2025.03 | 4.46 | — | — | — | — | — | — | — | — | — | — | |
| CEBackbone=ResNet110, Temperature Scaling=Post T2025.03 | 4.63 | — | — | — | — | — | — | — | — | — | — | |
| DFLBackbone=DenseNet, Temperature Scaling=Pre T2025.03 | 4.68 | — | — | — | — | — | — | — | — | — | — | |
| AlignMixup/AEBackbone=PreActResnet182021.03 | 5.06 | 0.48 | — | — | — | — | — | — | — | — | — | |
| MBLSBackbone=WideResNet-40-12025.12 | 5.37 | — | — | — | — | 69.97 | 0.22 | 5.37 | — | — | — | |
| DFLBackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 5.45 | — | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 5.53 | — | — | — | — | — | — | — | — | — | — | |
| AlignMixupBackbone=PreActResnet182021.03 | 5.78 | 0.41 | — | — | — | — | — | — | — | — | — | |
| Co-MixupBackbone=PreActResnet182021.03 | 5.83 | 0.55 | — | — | — | — | — | — | — | — | — | |
| Saliency MixBackbone=PreActResnet182021.03 | 5.89 | 0.59 | — | — | — | — | — | — | — | — | — | |
| FLSDBackbone=ResNet110, Temperature Scaling=Pre T2025.03 | 6.88 | — | — | — | — | — | — | — | — | — | — | |
| ACLSBackbone=WideResNet-40-12025.12 | 7 | — | — | — | — | 69.92 | 0.23 | 6.99 | — | — | — | |
| DPSBackbone=WideResNet-40-1, Hyperparameters=gamma = 0.95, c = 40002025.12 | 7.08 | — | — | — | — | 72.79 | 0.23 | 7.08 | — | — | — | |
| MMCEBackbone=WideResNet-40-12025.12 | 7.34 | — | — | — | — | 69.69 | 0.25 | 7.37 | — | — | — | |
| MixupBackbone=ResNet-502026.03 | 7.52 | — | — | — | — | — | — | — | 1.407 | — | — | |
| CutMixBackbone=PreActResnet182021.03 | 7.6 | 1.05 | — | — | — | — | — | — | — | — | — | |
| CPCBackbone=WideResNet-40-12025.12 | 7.61 | — | — | — | — | 69.99 | 0.23 | 7.55 | — | — | — | |
| BLBackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 7.74 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 7.87 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=DenseNet, Temperature Scaling=Pre T2025.03 | 8.13 | — | — | — | — | — | — | — | — | — | — | |
| PuzzleMixBackbone=PreActResnet182021.03 | 8.22 | 0.61 | — | — | — | — | — | — | — | — | — | |
| KD + CPCBackbone=WideResNet-40-12025.12 | 9.02 | — | — | — | — | 70 | 0.26 | 9.01 | — | — | — | |
| StyleCutMixBackbone=PreActResnet182021.03 | 9.3 | 0.87 | — | — | — | — | — | — | — | — | — | |
| BaselineBackbone=PreActResnet182021.03 | 10.25 | 1.11 | — | — | — | — | — | — | — | — | — | |
| Baseline (NLL)Backbone=WideResNet-40-12025.12 | 11.16 | — | — | — | — | 70.04 | 0.3 | 11.19 | — | — | — | |
| StyleMixBackbone=PreActResnet182021.03 | 11.43 | 1.31 | — | — | — | — | — | — | — | — | — | |
| Focal LossBackbone=ResNet-502026.03 | 12.86 | — | — | — | — | — | — | — | 1.55 | — | — | |
| CRLBackbone=WideResNet-40-12025.12 | 13.91 | — | — | — | — | 65.8 | 0.37 | 13.91 | — | — | — | |
| MMCEBackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 14.58 | — | — | — | — | — | — | — | — | — | — | |
| CEBackbone=WideResNet, Temperature Scaling=Pre T2025.03 | 14.81 | — | — | — | — | — | — | — | — | — | — | |
| KDBackbone=WideResNet-40-12025.12 | 15.18 | — | — | — | — | 69.6 | 0.37 | 15.18 | — | — | — | |
| MMCEBackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 15.87 | — | — | — | — | — | — | — | — | — | — | |
| BLBackbone=ResNet110, Temperature Scaling=Pre T2025.03 | 16.77 | — | — | — | — | — | — | — | — | — | — | |
| MMCEBackbone=DenseNet, Temperature Scaling=Pre T2025.03 | 17.56 | — | — | — | — | — | — | — | — | — | — | |
| CEBackbone=ResNet50, Temperature Scaling=Pre T2025.03 | 18.05 | — | — | — | — | — | — | — | — | — | — | |
| ManifoldBackbone=PreActResnet182021.03 | 18.41 | 0.79 | — | — | — | — | — | — | — | — | — | |
| InputBackbone=PreActResnet182021.03 | 18.5 | 1.42 | — | — | — | — | — | — | — | — | — |