OOD Detection on CIFAR-100 (vs SVHN, LSUN, iSUN, Textures, Places365)
0Average FPR95MSP-OE
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MSP-OEBackbone=ResNet-182024.05 | 0 | — | — | — | — | — | — | — | — | — | — | 98.5 | |
| Hopfield BoostingBackbone=ResNet-182024.05 | 2.35 | — | — | — | — | — | — | — | — | — | — | 99.22 | |
| DALBackbone=ResNet-182024.05 | 2.89 | — | — | — | — | — | — | — | — | — | — | 98.97 | |
| POEMBackbone=ResNet-182024.05 | 5.07 | — | — | — | — | — | — | — | — | — | — | 98.15 | |
| DOSBackbone=ResNet-182024.05 | 6.02 | — | — | — | — | — | — | — | — | — | — | 98.33 | |
| EBO-OEBackbone=ResNet-182024.05 | 10.34 | — | — | — | — | — | — | — | — | — | — | 97.42 | |
| MixOEBackbone=ResNet-182024.05 | 13.48 | — | — | — | — | — | — | — | — | — | — | 94.24 | |
| DOEBackbone=ResNet-182024.05 | 14.4 | — | — | — | — | — | — | — | — | — | — | 94.93 | |
| DivOEBackbone=ResNet-182024.05 | 28.99 | — | — | — | — | — | — | — | — | — | — | 94.24 | |
| DALData Setup=Using ID data and auxiliary OOD data2023.11 | 29.68 | 19.35 | 96.21 | 16.05 | 96.78 | 26.05 | 94.23 | 37.6 | 91.57 | 49.35 | 90.81 | 93.92 | |
| POEMData Setup=Using ID data and auxiliary OOD data2023.11 | 34.77 | 22.27 | 96.28 | 13.66 | 97.52 | 42.46 | 91.97 | 45.94 | 90.42 | 49.5 | 90.21 | 93.28 | |
| Energy-OEData Setup=Using ID data and auxiliary OOD data2023.11 | 36.28 | 35.34 | 94.74 | 16.27 | 97.25 | 33.21 | 93.25 | 46.13 | 90.62 | 50.45 | 90.04 | 93.18 | |
| ATOMData Setup=Using ID data and auxiliary OOD data2023.11 | 37.84 | 24.8 | 95.15 | 17.83 | 96.76 | 47.83 | 91.06 | 44.86 | 91.8 | 53.92 | 88.88 | 92.73 | |
| DOEData Setup=Using ID data and auxiliary OOD data2023.11 | 40.95 | 43.1 | 91.83 | 13.95 | 97.56 | 47.25 | 87.88 | 49.4 | 88.62 | 51.05 | 88.08 | 90.79 | |
| OEData Setup=Using ID data and auxiliary OOD data2023.11 | 43.14 | 46.73 | 90.54 | 16.3 | 96.98 | 47.97 | 88.43 | 50.39 | 88.27 | 54.3 | 87.11 | 90.27 | |
| KNN+Data Setup=Using ID data only2023.11 | 45.2 | 32.5 | 93.86 | 47.41 | 84.93 | 39.82 | 91.12 | 43.05 | 88.55 | 63.26 | 79.28 | 87.55 | |
| ASHData Setup=Using ID data only2023.11 | 59.31 | 70.09 | 83.56 | 13.2 | 97.71 | 69.87 | 82.56 | 63.69 | 83.59 | 79.7 | 74.87 | 84.46 | |
| KNNData Setup=Using ID data only2023.11 | 59.62 | 52.1 | 88.83 | 68.82 | 79 | 42.17 | 90.59 | 42.79 | 89.07 | 92.21 | 61.08 | 81.71 | |
| CSIData Setup=Using ID data only2023.11 | 61.12 | 64.5 | 84.62 | 25.88 | 95.93 | 70.62 | 80.83 | 61.5 | 86.74 | 83.08 | 77.11 | 95.05 | |
| Free EnergyData Setup=Using ID data only2023.11 | 69.84 | 85.24 | 73.71 | 23.05 | 95.89 | 81.11 | 79.02 | 79.63 | 76.35 | 80.18 | 75.65 | 80.12 | |
| MahalanobisData Setup=Using ID data only2023.11 | 72.37 | 51 | 88.7 | 91.6 | 69.69 | 38.48 | 91.86 | 47.07 | 89.09 | 82.7 | 74.18 | 82.7 | |
| VOSData Setup=Using ID data only2023.11 | 73.8 | 78.06 | 92.59 | 40.4 | 92.9 | 85.77 | 70.2 | 82.46 | 77.22 | 82.31 | 75.47 | 91.67 | |
| MSPData Setup=Using ID data only2023.11 | 78.61 | 84.39 | 71.18 | 60.36 | 85.59 | 82.63 | 75.69 | 83.32 | 73.59 | 82.37 | 73.69 | 75.95 |