OOD Detection on CIFAR-100 (vs EMNIST, MNIST, SVHN, LSUN, iSUN, Texture)
1.1FPR95 (EMNIST)Line
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LineBackbone=DenseNet-1012026.02 | 1.1 | 99.3 | 0.01 | 99.7 | 32.9 | 92.9 | 35.1 | 89.1 | 3.1 | 99.3 | 34.6 | 93.5 | 29.2 | 94.5 | 19.4 | 95.5 | |
| KNNBackbone=DenseNet-1012026.02 | 2.1 | 98.6 | 1.6 | 98.6 | 17.5 | 96.4 | 24.3 | 93.7 | 31.4 | 92.8 | 47.3 | 90.4 | 39.7 | 91.9 | 23.4 | 94.6 | |
| D-KNNBackbone=DenseNet-1012026.02 | 5 | 98.3 | 5.5 | 98.1 | 25.1 | 95.1 | 23.1 | 94.2 | 21.8 | 95.8 | 21.2 | 96 | 21.3 | 96 | 17.6 | 96.2 | |
| EnergyBackbone=ResNet182026.02 | 24.1 | 96.2 | 19.1 | 96.9 | 81 | 81.1 | 85.6 | 74 | 70.5 | 84 | 72.3 | 85.3 | 74.8 | 83.6 | 61.1 | 85.9 | |
| ReActBackbone=ResNet182026.02 | 24.3 | 96.1 | 19.3 | 96.9 | 81.1 | 81 | 85.5 | 75.6 | 70.5 | 84.3 | 72.6 | 85.4 | 74.9 | 83.9 | 61.2 | 86.2 | |
| DICEBackbone=DenseNet-1012026.02 | 26 | 95.3 | 10.6 | 98.1 | 59.4 | 88.6 | 61.5 | 77.1 | 0.9 | 99.7 | 55 | 88.2 | 52.5 | 88.5 | 38 | 90.8 | |
| MaxLogitBackbone=ResNet182026.02 | 30.2 | 95.5 | 25.3 | 96.3 | 80.7 | 81 | 85.5 | 74.3 | 71.8 | 83.7 | 72.5 | 85.2 | 75.4 | 83.5 | 63.1 | 85.6 | |
| DICEBackbone=ResNet182026.02 | 32.6 | 95.7 | 23.8 | 96.4 | 74.3 | 83.4 | 86.5 | 72.2 | 66.9 | 85.2 | 82.2 | 82.8 | 82.1 | 81.7 | 64.1 | 85.3 | |
| MSPBackbone=ResNet182026.02 | 38.4 | 93.5 | 35.2 | 94.7 | 81.3 | 79.2 | 85.4 | 74.1 | 74 | 81.6 | 74.5 | 83.4 | 77.7 | 81.7 | 66.6 | 84 | |
| FDBDBackbone=ResNet182026.02 | 41.2 | 93.1 | 38.6 | 93.9 | 77.2 | 82.3 | 79.3 | 79.8 | 74 | 81.8 | 69.6 | 86.6 | 72.6 | 85.3 | 64.6 | 86.1 | |
| D-KNNBackbone=ResNet182026.02 | 45.5 | 92.3 | 54.9 | 91.2 | 61.7 | 86.2 | 63 | 83.7 | 67.8 | 82.4 | 71.2 | 85.8 | 71.9 | 84.6 | 62.3 | 86.6 | |
| ViMBackbone=DenseNet-1012026.02 | 50.5 | 89.8 | 41.5 | 92.7 | 97 | 56.3 | 86.9 | 63.6 | 31.3 | 92.4 | 90.1 | 61.5 | 91.5 | 60.8 | 69.8 | 73.9 | |
| LineBackbone=ResNet182026.02 | 51.1 | 92.3 | 48.6 | 93.2 | 73.9 | 82 | 81.2 | 73.8 | 66.6 | 85.6 | 86 | 77.2 | 84.8 | 78 | 70.3 | 83.2 | |
| ReActBackbone=DenseNet-1012026.02 | 64.5 | 87.8 | 60 | 89.4 | 83 | 83.2 | 79.7 | 77.7 | 15.8 | 97.1 | 71.5 | 81.7 | 75.1 | 81.1 | 64.2 | 85.4 | |
| FDBDBackbone=DenseNet-1012026.02 | 64.8 | 87.6 | 56.9 | 89.8 | 53.8 | 90.4 | 45.8 | 91.1 | 22.3 | 96 | 62.7 | 86.6 | 62 | 87.3 | 52.6 | 89.8 | |
| KNNBackbone=ResNet182026.02 | 66.8 | 89.7 | 83.5 | 87.9 | 54.8 | 86.7 | 63 | 83 | 71.4 | 80.9 | 70.5 | 86.9 | 69.6 | 85.9 | 68.5 | 85.9 | |
| MaxLogitBackbone=DenseNet-1012026.02 | 74.6 | 84.1 | 64 | 88.2 | 85.4 | 81.9 | 83.5 | 71.2 | 16.9 | 97.1 | 76 | 77.4 | 79.1 | 76.5 | 68.6 | 82.3 | |
| EnergyBackbone=DenseNet-1012026.02 | 74.8 | 84.3 | 62.9 | 88.6 | 87.5 | 81.9 | 84.3 | 71 | 14.8 | 97.4 | 75.4 | 77.8 | 78.7 | 76.8 | 68.3 | 82.6 | |
| MahalanobisBackbone=DenseNet-1012026.02 | 83.4 | 84.1 | 98.6 | 72.3 | 54.6 | 88.1 | 28.3 | 92.2 | 96.5 | 44.4 | 38.3 | 92.1 | 36.1 | 92.4 | 62.3 | 80.5 | |
| MSPBackbone=DenseNet-1012026.02 | 83.9 | 75.3 | 82.9 | 76.5 | 81.8 | 75.4 | 84.8 | 71.4 | 60.4 | 85.6 | 87.2 | 67.1 | 88 | 68.5 | 81.3 | 75.7 | |
| ViMBackbone=ResNet182026.02 | 91.6 | 67.4 | 96.9 | 62.1 | 92.8 | 62.1 | 89.2 | 62.2 | 95.4 | 58.5 | 91 | 63.3 | 90.3 | 64.2 | 91 | 62.8 | |
| MahalanobisBackbone=ResNet182026.02 | 99.7 | 47.7 | 100 | 40.9 | 90.4 | 71.4 | 72.1 | 75.6 | 95.7 | 55.7 | 89.8 | 68.8 | 85.6 | 70.3 | 90.5 | 61.5 |