Multi-Class Out-of-Distribution Detection on CIFAR-10 (ID) vs Places365 (OOD) (test)
0.22FPR@95Deep Abstaining Classifier
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Deep Abstaining ClassifierBackbone=Wide ResNet 40x22021.05 | 0.22 | 99.92 | — | — | — | — | — | — | — | |
| Deep Abstaining ClassifierBackbone=ResNet 342021.05 | 0.84 | 99.67 | — | — | — | — | — | — | — | |
| AHGCBackbone=ResNet-18, Optimizer=SGD2024.12 | 10.24 | 97.24 | — | 94.74 | 98.82 | 37.19 | 59.12 | 76.67 | 89.54 | |
| Outlier ExposureBackbone=Wide ResNet 40x22021.05 | 17.3 | 96.2 | — | — | — | — | — | — | — | |
| OpenMaxBackbone=ResNet 342021.05 | 27.27 | 90.72 | — | — | — | — | — | — | — | |
| ConjNormBackbone=ResNet-18, Optimizer=SGD2024.12 | 36.02 | 93.58 | — | 86.72 | 95.85 | 12.4 | 40.1 | 60.7 | 82.34 | |
| Auxiliary Rotation Predictionaverage_of_runs=52019.06 | 38.4 | 92.2 | 71.3 | — | — | — | — | — | — | |
| UDGBackbone=ResNet-18, Optimizer=SGD2024.12 | 44.22 | 92.64 | — | 87.17 | 96.66 | 10.62 | 35.05 | 58.96 | 79.63 | |
| Maximum Softmax Probability (MSP)average_of_runs=52019.06 | 46 | 87.7 | 57.2 | — | — | — | — | — | — | |
| SconeBackbone=ResNet-18, Optimizer=SGD2024.12 | 48.63 | 87.58 | — | 80.49 | 92.93 | 16.73 | 42.76 | 62.57 | 81.53 | |
| EBOBackbone=ResNet-18, Optimizer=SGD2024.12 | 52.16 | 83.86 | — | 58.96 | 93.9 | 0.39 | 2.11 | 8.38 | 46 | |
| ODINBackbone=ResNet-18, Optimizer=SGD2024.12 | 53.94 | 82.01 | — | 54.92 | 93.3 | 0.47 | 1.68 | 7.13 | 39.63 | |
| OEBackbone=ResNet-18, Optimizer=SGD2024.12 | 55.64 | 87 | — | 73.11 | 94.67 | 11.36 | 17.36 | 26.33 | 62.23 | |
| MCDBackbone=ResNet-18, Optimizer=SGD2024.12 | 72.08 | 83.51 | — | 69.44 | 92.52 | 3.29 | 7.97 | 23.07 | 60.22 |