Out-of-Distribution Detection on CIFAR-100 original (test)
2.9SVHN FPR95CER
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CERBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 2.9 | 98.86 | 0.05 | 97.98 | 70.55 | 81.34 | 12.42 | 97.06 | 24.63 | 94.53 | 26.49 | 94.07 | 22.84 | 93.97 | |
| PALMBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 3.03 | 99.23 | 34.46 | 93.74 | 67.8 | 82.62 | 10.58 | 97.7 | 41.56 | 91.36 | 44.06 | 91.43 | 33.58 | 92.68 | |
| CIDERBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 23.09 | 95.16 | 53.33 | 88.11 | 79.63 | 73.43 | 16.16 | 96.33 | 71.68 | 82.98 | 43.87 | 90.42 | 46.89 | 87.67 | |
| kNN+Backbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 39.23 | 92.78 | 81.34 | 76.16 | 80.74 | 77.58 | 48.99 | 89.3 | 74.99 | 82.69 | 57.15 | 88.35 | 62.88 | 84.48 | |
| LogitNormBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 59.6 | 90.74 | 86.73 | 76.33 | 80.25 | 78.58 | 81.07 | 82.99 | 84.19 | 80.77 | 86.64 | 75.6 | 79.75 | 80.84 | |
| EnergyBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 66.91 | 85.25 | 91.49 | 74.59 | 81.41 | 76.37 | 59.77 | 86.69 | 66.52 | 84.49 | 79.01 | 79.96 | 74.18 | 81.22 | |
| ODINBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 70.16 | 84.88 | 92.33 | 71.54 | 82.16 | 75.19 | 76.36 | 80.1 | 79.54 | 79.16 | 85.28 | 75.23 | 80.97 | 77.68 | |
| MSPBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 78.89 | 79.8 | 88.23 | 78.25 | 84.38 | 74.21 | 83.47 | 75.28 | 84.61 | 74.51 | 86.51 | 72.53 | 84.35 | 75.76 | |
| MahalanobisBackbone=ResNet-34, In-distribution (ID) dataset=CIFAR-1002026.02 | 87.09 | 80.62 | 70.78 | 83.79 | 84.63 | 73.89 | 84.15 | 79.43 | 83.18 | 78.83 | 61.72 | 84.87 | 78.59 | 80.24 |