Uncertainty Calibration on CIFAR-10-C
5.2RMS Calibration ErrorAUGMIX
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| AUGMIXBackbone=AllConvNet2019.12 | 5.2 | — | — | — | — | |
| AUGMIXBackbone=ResNeXt2019.12 | 8.3 | — | — | — | — | |
| AUGMIXBackbone=Mean2019.12 | 8.5 | — | — | — | — | |
| AUGMIXBackbone=WideResNet2019.12 | 8.7 | — | — | — | — | |
| MixupBackbone=AllConvNet2019.12 | 9.7 | — | — | — | — | |
| Adv TrainingBackbone=AllConvNet2019.12 | 10.4 | — | — | — | — | |
| Adv TrainingBackbone=WideResNet2019.12 | 10.6 | — | — | — | — | |
| MixupBackbone=WideResNet2019.12 | 11.1 | — | — | — | — | |
| MixupBackbone=Mean2019.12 | 11.4 | — | — | — | — | |
| Adv TrainingBackbone=ResNeXt2019.12 | 11.6 | — | — | — | — | |
| AUGMIXBackbone=DenseNet2019.12 | 11.7 | — | — | — | — | |
| MixupBackbone=ResNeXt2019.12 | 11.7 | — | — | — | — | |
| Adv TrainingBackbone=Mean2019.12 | 11.9 | — | — | — | — | |
| MixupBackbone=DenseNet2019.12 | 12.9 | — | — | — | — | |
| Adv TrainingBackbone=DenseNet2019.12 | 15 | — | — | — | — | |
| AutoAugment*Backbone=ResNeXt2019.12 | 15.1 | — | — | — | — | |
| CutMixBackbone=AllConvNet2019.12 | 15.4 | — | — | — | — | |
| AutoAugment*Backbone=AllConvNet2019.12 | 16.2 | — | — | — | — | |
| StandardBackbone=ResNeXt2019.12 | 16.4 | — | — | — | — | |
| AutoAugment*Backbone=WideResNet2019.12 | 17.1 | — | — | — | — | |
| AutoAugment*Backbone=Mean2019.12 | 17.4 | — | — | — | — | |
| CutMixBackbone=WideResNet2019.12 | 17.8 | — | — | — | — | |
| CutoutBackbone=WideResNet2019.12 | 19.6 | — | — | — | — | |
| CutMixBackbone=ResNeXt2019.12 | 19.6 | — | — | — | — | |
| CutMixBackbone=Mean2019.12 | 19.6 | — | — | — | — | |
| AutoAugment*Backbone=DenseNet2019.12 | 21.1 | — | — | — | — | |
| StandardBackbone=AllConvNet2019.12 | 21.2 | — | — | — | — | |
| CutoutBackbone=AllConvNet2019.12 | 21.3 | — | — | — | — | |
| CutoutBackbone=ResNeXt2019.12 | 21.4 | — | — | — | — | |
| CutoutBackbone=Mean2019.12 | 22.5 | — | — | — | — | |
| StandardBackbone=Mean2019.12 | 23 | — | — | — | — | |
| CutMixBackbone=DenseNet2019.12 | 25.6 | — | — | — | — | |
| StandardBackbone=DenseNet2019.12 | 26.7 | — | — | — | — | |
| StandardBackbone=WideResNet2019.12 | 27.6 | — | — | — | — | |
| CutoutBackbone=DenseNet2019.12 | 27.8 | — | — | — | — | |
| DIRECTORBackbone=ViT2026.02 | — | 68.89 | 22.32 | 17.71 | 51.77 | |
| DIRECTORBackbone=KEP-1/72026.02 | — | 69.29 | 20.98 | 16.23 | 50.07 | |
| DIRECTORBackbone=KEP-7/72026.02 | — | 68.12 | 22.19 | 17.7 | 52.27 | |
| KEP-1/72026.02 | — | 69.87 | 22.12 | 18.54 | 50.65 | |
| KEP-7/72026.02 | — | 59.57 | 21.78 | 17.17 | 60.67 | |
| ViT2026.02 | — | 69.67 | 24.3 | 23.59 | 53.07 |