OOD Detection on CIFAR-10 (vs SVHN, LSUN, ISUN, Texture, Places365)
0.34FPR95 (SVHN)PALM
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PALMBackbone=ResNet-182026.05 | 0.34 | 99.91 | 1.11 | 99.65 | 34.07 | 95.17 | 10.48 | 98.29 | 28.81 | 94.8 | 14.96 | 97.57 | |
| DALData Setup=Using ID data and auxiliary OOD data2023.11 | 0.8 | 99.65 | 0.9 | 99.46 | 1.7 | 99.34 | 2.3 | 99.14 | 7.65 | 97.45 | 2.68 | 99.01 | |
| Energy-OEData Setup=Using ID data and auxiliary OOD data2023.11 | 0.97 | 99.54 | 1 | 99.15 | 2.32 | 99.27 | 3.42 | 99.18 | 9.57 | 97.44 | 3.46 | 98.91 | |
| ATOMData Setup=Using ID data and auxiliary OOD data2023.11 | 1 | 99.59 | 0.61 | 99.53 | 2.15 | 99.4 | 2.52 | 99.1 | 7.93 | 97.27 | 2.84 | 98.97 | |
| POEMData Setup=Using ID data and auxiliary OOD data2023.11 | 1.2 | 99.53 | 0.8 | 99.1 | 1.47 | 99.26 | 2.93 | 99.13 | 7.65 | 97.35 | 2.81 | 98.87 | |
| EIHFBackbone=ResNet-182026.05 | 1.36 | 99.75 | 5.17 | 98.54 | 13.69 | 97.14 | 9.42 | 97.54 | 18.57 | 96.89 | 9.64 | 97.97 | |
| DPLBackbone=ResNet-182026.05 | 1.51 | 99.71 | 2.24 | 99.47 | 12.41 | 97.84 | 7.23 | 98.81 | 19.65 | 96.39 | 8.61 | 98.45 | |
| DOEData Setup=Using ID data and auxiliary OOD data2023.11 | 1.8 | 99.37 | 0.25 | 99.65 | 2 | 99.36 | 5.65 | 98.75 | 10.15 | 97.28 | 3.97 | 98.88 | |
| OEData Setup=Using ID data and auxiliary OOD data2023.11 | 2.36 | 99.27 | 1.15 | 99.68 | 2.48 | 99.34 | 5.35 | 98.88 | 11.99 | 97.23 | 4.67 | 98.88 | |
| SSD+Backbone=ResNet-182026.05 | 2.47 | 99.51 | 10.56 | 97.83 | 28.44 | 95.67 | 9.27 | 98.35 | 22.05 | 95.57 | 14.56 | 97.39 | |
| KNN+Backbone=ResNet-182026.05 | 2.7 | 99.61 | 7.89 | 98.01 | 24.56 | 96.21 | 10.11 | 97.43 | 23.05 | 94.88 | 13.66 | 97.23 | |
| CIDERBackbone=ResNet-182026.05 | 2.89 | 99.72 | 5.75 | 99.01 | 20.21 | 96.64 | 12.33 | 96.85 | 23.88 | 94.09 | 13.01 | 97.26 | |
| KNN+Data Setup=Using ID data only2023.11 | 3.28 | 99.33 | 2.24 | 98.9 | 17.85 | 95.65 | 10.87 | 97.72 | 30.63 | 94.98 | 12.97 | 97.32 | |
| NPOSBackbone=ResNet-182023.03 | 5.61 | 97.64 | 4.08 | 97.52 | 14.13 | 94.92 | 8.39 | 94.67 | 18.57 | 91.35 | 10.16 | 95.22 | |
| DRLBackbone=ResNet-182026.05 | 7.91 | 98.82 | 12.87 | 99.09 | 11.92 | 98.12 | 4.92 | 97.48 | 19.17 | 95.65 | 11.58 | 97.83 | |
| MahalanobisData Setup=Using ID data only2023.11 | 12.21 | 97.7 | 57.25 | 89.58 | 79.74 | 77.87 | 15.2 | 95.4 | 68.81 | 82.39 | 46.64 | 88.59 | |
| VOSBackbone=ResNet-182023.03 | 15.69 | 96.37 | 27.64 | 93.82 | 30.42 | 94.87 | 32.68 | 93.68 | 37.95 | 91.78 | 27.88 | 94.1 | |
| VOSBackbone=ResNet-182026.05 | 15.69 | 96.37 | 27.64 | 93.82 | 30.42 | 94.87 | 32.68 | 93.68 | 37.95 | 91.78 | 28.88 | 94.1 | |
| CSIData Setup=Using ID data only2023.11 | 17.37 | 97.69 | 6.75 | 98.46 | 12.58 | 97.95 | 25.65 | 94.7 | 40 | 92.05 | 20.47 | 96.17 | |
| ODINBackbone=ResNet-182023.03 | 20.93 | 95.55 | 7.26 | 98.53 | 33.17 | 94.65 | 56.4 | 86.21 | 63.04 | 86.57 | 36.16 | 92.3 | |
| ODINBackbone=ResNet-182026.05 | 20.93 | 95.55 | 31.92 | 94.82 | 33.17 | 94.65 | 56.4 | 86.21 | 63.04 | 86.57 | 41.09 | 91.56 | |
| KNNBackbone=ResNet-182023.03 | 24.53 | 95.96 | 25.29 | 95.69 | 25.55 | 95.26 | 27.57 | 94.71 | 50.9 | 89.14 | 30.77 | 94.15 | |
| ViMBackbone=ResNet-182023.03 | 24.95 | 95.36 | 18.8 | 96.63 | 29.25 | 95.1 | 24.35 | 95.2 | 44.7 | 90.71 | 28.41 | 94.6 | |
| VimBackbone=ResNet-182026.05 | 24.95 | 95.36 | 7.26 | 98.53 | 33.17 | 94.65 | 56.4 | 86.21 | 63.04 | 86.57 | 36.96 | 92.26 | |
| KNNData Setup=Using ID data only2023.11 | 26.56 | 95.93 | 27.52 | 95.43 | 33.55 | 93.15 | 37.62 | 93.07 | 41.67 | 91.21 | 33.38 | 93.76 | |
| ASHBackbone=ResNet-182026.05 | 28.94 | 94.84 | 9.06 | 98.34 | 21.61 | 95.95 | 35.02 | 93.63 | 27.29 | 91.31 | 27.29 | 94.81 | |
| ASHData Setup=Using ID data only2023.11 | 33.98 | 91.79 | 4.76 | 98.98 | 34.38 | 92.64 | 50.9 | 86.07 | 40.89 | 89.79 | 32.98 | 91.85 | |
| Free EnergyData Setup=Using ID data only2023.11 | 35.21 | 91.24 | 4.42 | 99.06 | 33.84 | 92.56 | 52.46 | 85.35 | 40.11 | 90.02 | 33.21 | 91.64 | |
| VOSData Setup=Using ID data only2023.11 | 36.55 | 93.3 | 9.98 | 98.03 | 28.93 | 94.25 | 52.83 | 85.74 | 39.56 | 89.71 | 33.57 | 92.21 | |
| ReActBackbone=ResNet-182026.05 | 48.16 | 92.32 | 18.09 | 96.91 | 20.35 | 95.59 | 96.51 | 47.41 | 37.25 | 93.13 | 34.25 | 94.09 | |
| MSPData Setup=Using ID data only2023.11 | 48.89 | 91.97 | 25.53 | 96.49 | 56.44 | 89.86 | 59.68 | 88.42 | 60.19 | 88.36 | 50.15 | 91.02 | |
| EnergyBackbone=ResNet-182023.03 | 54.41 | 91.22 | 10.19 | 98.05 | 27.52 | 95.59 | 55.23 | 89.37 | 42.77 | 91.02 | 38.02 | 93.05 | |
| EnergyBackbone=ResNet-182026.05 | 54.41 | 91.22 | 23.45 | 96.14 | 27.52 | 95.59 | 55.23 | 89.37 | 42.77 | 91.02 | 40.68 | 92.67 | |
| MSPBackbone=ResNet-182023.03 | 59.66 | 91.25 | 45.21 | 93.8 | 54.57 | 92.12 | 66.45 | 88.5 | 62.46 | 88.64 | 57.67 | 90.86 | |
| MSPBackbone=ResNet-182026.05 | 59.66 | 91.25 | 51.93 | 92.73 | 54.57 | 92.12 | 66.45 | 88.5 | 62.46 | 88.64 | 59.01 | 90.65 | |
| GradNormBackbone=ResNet-182023.03 | 80.86 | 81.41 | 53.87 | 88.39 | 60.32 | 88 | 71.66 | 80.79 | 80.71 | 72.57 | 69.49 | 82.23 |