OOD Detection on CIFAR-10 vs SVHN (test)
99.86AUROCENSEMBLE+OOD HE-CKA
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSEMBLE+OOD HE-CKAOOD Method=PE, Backbone=ResNet18, Ensemble size=52024.10 | 99.86 | 0.123 | 96.24 | 58 | — | — | — | — | — | — | — | |
| MMCE Kumar et al. (2018)Backbone=ResNet-502026.05 | 98.3 | — | — | — | — | — | — | 12.1 | 6.9 | 98.4 | 98.2 | |
| AUCM + RefCal (Ours)Backbone=ResNet-502026.05 | 98.2 | — | — | — | — | — | — | 10.2 | 6.6 | 98.5 | 98 | |
| CE+TS + RefCal (Ours)Backbone=ResNet-502026.05 | 97.9 | — | — | — | — | — | — | 14.1 | 6.8 | 98.2 | 97.6 | |
| WIDERESNET28-10+SNOOD Method=GMM, Backbone=WideResNet-28-10, Ensemble size=12024.10 | 97.86 | — | 95.97 | 85 | — | — | — | — | — | — | — | |
| NLL (CE) + RefCal (Ours)Backbone=ResNet-502026.05 | 97.5 | — | — | — | — | — | — | 16.3 | 7.1 | 97.7 | 97 | |
| CRL + RefCal (Ours)Backbone=ResNet-502026.05 | 97.5 | — | — | — | — | — | — | 16.3 | 7.1 | 97.7 | 97 | |
| MMCE + RefCal (Ours)Backbone=ResNet-502026.05 | 97.3 | — | — | — | — | — | — | 20.8 | 10.3 | 85.8 | 95.6 | |
| FL+ MDCA + RefCal (Ours)Backbone=ResNet-502026.05 | 97.3 | — | — | — | — | — | — | 18 | 7.2 | 97.4 | 96.5 | |
| MbLS + RefCal (Ours)Backbone=ResNet-502026.05 | 97.2 | — | — | — | — | — | — | 16.9 | 7.8 | 97.7 | 96.6 | |
| LS + RefCal (Ours)Backbone=ResNet-502026.05 | 97.1 | — | — | — | — | — | — | 17 | 8.2 | 97.6 | 96.3 | |
| FL+ MDCA Hebbalaguppe et al. (2022b)Backbone=ResNet-502026.05 | 97.1 | — | — | — | — | — | — | 20.5 | 8 | 97.7 | 96.6 | |
| CE+TS Guo et al. (2017)Backbone=ResNet-502026.05 | 97 | — | — | — | — | — | — | 22.2 | 8.1 | 97.6 | 96.4 | |
| ENSEMBLE+HE-CKAOOD Method=PE, Backbone=ResNet18, Ensemble size=52024.10 | 96.71 | 0.12 | 96.23 | 59 | — | — | — | — | — | — | — | |
| MbLS Liu et al. (2022)Backbone=ResNet-502026.05 | 96.4 | — | — | — | — | — | — | 25 | 8.2 | 97.1 | 95.1 | |
| CRL Moon et al. (2020)Backbone=ResNet-502026.05 | 96.3 | — | — | — | — | — | — | 27.9 | 8.2 | 97.2 | 95.3 | |
| ENSEMBLEOOD Method=PE, Backbone=ResNet18, Ensemble size=52024.10 | 96.18 | 0.122 | 96.34 | 108 | — | — | — | — | — | — | — | |
| SVGD+CKApwOOD Method=PE, Backbone=ResNet18, Ensemble size=52024.10 | 96.07 | 0.125 | 96.25 | 41 | — | — | — | — | — | — | — | |
| SVGD+HE-CKAOOD Method=PE, Backbone=ResNet18, Ensemble size=52024.10 | 96.01 | 0.124 | 96.23 | 63 | — | — | — | — | — | — | — | |
| NLL (CE)Backbone=ResNet-502026.05 | 95.9 | — | — | — | — | — | — | 30.5 | 8.8 | 96.9 | 94.7 | |
| SVGD+RBFOOD Method=PE, Backbone=ResNet18, Ensemble size=52024.10 | 95.37 | 0.143 | 95.71 | 119 | — | — | — | — | — | — | — | |
| AUCM Yuan (2021)Backbone=ResNet-502026.05 | 93.4 | — | — | — | — | — | — | 38.3 | 12.1 | 93.6 | 92.4 | |
| LS Szegedy et al. (2015)Backbone=ResNet-502026.05 | 92.6 | — | — | — | — | — | — | 29.3 | 9.3 | 86.8 | 92.4 | |
| SWAGOptimizer=SWAG2025.11 | 87.9 | — | — | — | — | — | — | 19.7 | 17.5 | 84.1 | 92.4 | |
| uCBOptOptimizer=uCBOpt (ϑ → 0+)2025.11 | 86.8 | — | — | — | — | — | — | 21.2 | 18.7 | 82 | 91.8 | |
| IVONOptimizer=IVON2025.11 | 86 | — | — | — | — | — | — | 22.3 | 19.3 | 81.6 | 91.1 | |
| uCBOptOptimizer=uCBOpt (ϑ = 5 ⋅ 10−5)2025.11 | 86 | — | — | — | — | — | — | 21.9 | 19.6 | 80.4 | 91.4 | |
| LaplaceOptimizer=Laplace2025.11 | 85.9 | — | — | — | — | — | — | 24.4 | 20 | 80.1 | 91.5 | |
| lCBOpt-adaptOptimizer=lCBOpt-adapt2025.11 | 85.9 | — | — | — | — | — | — | 21.8 | 19.6 | 80.6 | 91.2 | |
| SGDOptimizer=SGD2025.11 | 85.8 | — | — | — | — | — | — | 23.1 | 20 | 80 | 91.3 | |
| uCBOpt-adaptOptimizer=uCBOpt-adapt2025.11 | 85.4 | — | — | — | — | — | — | 23.9 | 20.4 | 79.1 | 91.1 | |
| MC-DOptimizer=MC-D2025.11 | 84.4 | — | — | — | — | — | — | 23.3 | 21 | 79.2 | 90 | |
| IVONOptimizer=IVON@mean2025.11 | 84.2 | — | — | — | — | — | — | 25.1 | 21.3 | 78.5 | 90 | |
| AdamWOptimizer=AdamW2025.11 | 83 | — | — | — | — | — | — | 35.9 | 22.4 | 75.5 | 89.3 | |
| BMMetric=Mutual Information2024.02 | — | — | — | — | — | — | 96.9 | — | — | — | — | |
| BMMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 95 | — | — | — | — | |
| Bootstrap DistillMetric=Mutual Information2024.02 | — | — | — | — | — | — | 94.6 | — | — | — | — | |
| Bootstrap DistillMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 95.7 | — | — | — | — | |
| DDUBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.211 | 0.847 | 0.0426 | 0.8628 | — | — | — | — | — | — | |
| EDLMetric=Mutual Information2024.02 | — | — | — | — | — | — | 93.7 | — | — | — | — | |
| EDLMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 94.4 | — | — | — | — | |
| END2Metric=Mutual Information2024.02 | — | — | — | — | — | — | 93.3 | — | — | — | — | |
| END2Metric=Differential Entropy2024.02 | — | — | — | — | — | — | 95.1 | — | — | — | — | |
| ENSEMBLEBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.277 | 0.8555 | 0.049 | 0.843 | 0.736 | — | — | — | — | — | |
| ENSEMBLE + OOD HE-CKABackbone=modified ResNet32, Number of particles=102024.10 | — | 0.275 | 0.8613 | 0.0544 | 0.9648 | 0.9661 | — | — | — | — | — | |
| Fisher-EDLMetric=Mutual Information2024.02 | — | — | — | — | — | — | 82.2 | — | — | — | — | |
| Fisher-EDLMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 88.2 | — | — | — | — | |
| FSVGD + RBFBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.292 | 0.8551 | 0.049 | 0.783 | 0.712 | — | — | — | — | — | |
| HYPERNET + OOD HE-CKABackbone=modified ResNet32, Number of particles=102024.10 | — | 0.259 | 0.8364 | 0.0112 | 0.8812 | 0.8881 | — | — | — | — | — | |
| KDE - FWGD + RBFBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.282 | 0.8489 | 0.044 | 0.791 | 0.758 | — | — | — | — | — | |
| KDE - WGD + RBFBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.276 | 0.859 | 0.053 | 0.838 | 0.735 | — | — | — | — | — | |
| NatPNMetric=Mutual Information2024.02 | — | — | — | — | — | — | 43.9 | — | — | — | — | |
| NatPNMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 70.2 | — | — | — | — | |
| PostNetMetric=Mutual Information2024.02 | — | — | — | — | — | — | 90.9 | — | — | — | — | |
| PostNetMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 93.5 | — | — | — | — | |
| RPriorNetMetric=Mutual Information2024.02 | — | — | — | — | — | — | 68.2 | — | — | — | — | |
| RPriorNetMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 73.5 | — | — | — | — | |
| S2DMetric=Mutual Information2024.02 | — | — | — | — | — | — | 83 | — | — | — | — | |
| S2DMetric=Differential Entropy2024.02 | — | — | — | — | — | — | 89 | — | — | — | — | |
| SGE - FWGD + RBFBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.288 | 0.8477 | 0.047 | 0.795 | 0.754 | — | — | — | — | — | |
| SGE - WGD + RBFBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.275 | 0.8579 | 0.051 | 0.837 | 0.725 | — | — | — | — | — | |
| SVGD + CKApwBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.286 | 0.8483 | 0.0495 | 0.8889 | 0.7033 | — | — | — | — | — | |
| SVGD + HE-CKABackbone=modified ResNet32, Number of particles=102024.10 | — | 0.255 | 0.8589 | 0.0368 | 0.8923 | 0.7098 | — | — | — | — | — | |
| SVGD + RBFBackbone=modified ResNet32, Number of particles=102024.10 | — | 0.287 | 0.8514 | 0.052 | 0.825 | 0.71 | — | — | — | — | — |