Out-of-Distribution Detection on CIFAR10 (test)
2.47FPR95 (SVHN)GAIA-Z
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GAIA-ZBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 2.47 | 99.49 | 6.26 | 98.63 | 2.48 | 99.43 | 2.27 | 99.5 | 2.84 | 99.36 | 3.26 | 99.28 | — | |
| GAIA-ZBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 4.05 | 99.17 | 53.31 | 90.59 | 12.4 | 97.92 | 7.76 | 98.59 | 12.3 | 97.34 | 17.96 | 96.72 | — | |
| GAIA-ABackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 14.44 | 97.12 | 16.45 | 97.07 | 9.1 | 98.1 | 11.06 | 97.82 | 12.62 | 97.54 | 12.73 | 97.53 | — | |
| ODINBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 16.11 | 96.91 | 44.18 | 89.66 | 33.37 | 93.45 | 40.3 | 91.31 | 51.51 | 87.71 | 37.09 | 91.81 | — | |
| GAIA-ABackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 18.34 | 96.51 | 30.98 | 94.54 | 12.73 | 97.7 | 16.94 | 96.84 | 14.93 | 97.15 | 18.78 | 96.55 | — | |
| EnergyBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 19.94 | 95.8 | 41.7 | 90.04 | 37.95 | 91.44 | 44.88 | 89.67 | 55.89 | 84.58 | 40.07 | 90.31 | — | |
| ASH-P@70Backbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 19.94 | 95.8 | 41.7 | 90.04 | 37.96 | 91.44 | 44.53 | 89.75 | 55.69 | 84.71 | 39.97 | 90.35 | — | |
| ReActBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 20.05 | 95.87 | 41.32 | 90.29 | 37.81 | 91.57 | 44.28 | 89.77 | 54.88 | 85.54 | 39.67 | 90.61 | — | |
| MahalanobisBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 21.63 | 94.99 | 42.86 | 89.77 | 46.87 | 86.58 | 45.39 | 89.47 | 48.06 | 88.65 | 40.96 | 89.89 | — | |
| MahalanobisBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 22.19 | 93.36 | 29.35 | 90.16 | 25.31 | 91.89 | 28.61 | 91.26 | 39.34 | 87.02 | 28.96 | 90.74 | — | |
| ASH-P@70Backbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 23.11 | 95.53 | 29.78 | 93.71 | 22.72 | 95.33 | 25.27 | 94.35 | 30.92 | 93.08 | 26.36 | 94.4 | — | |
| ReActBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 24.6 | 92.39 | 33.68 | 89.71 | 19.15 | 93.78 | 23.69 | 92.78 | 32.61 | 89.27 | 26.75 | 91.59 | — | |
| KNNBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 27.52 | 95.55 | 38.14 | 93.44 | 38.95 | 94.3 | 45.79 | 90.65 | 50.37 | 90.77 | 40.16 | 92.94 | — | |
| KNNBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 32.03 | 95.28 | 29.56 | 95.44 | 27.42 | 95.92 | 41.77 | 93.26 | 35.41 | 94.87 | 33.24 | 94.95 | — | |
| MSPBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 40.51 | 92.7 | 50.05 | 86.99 | 38.9 | 91.34 | 45.41 | 89.58 | 56.42 | 84.57 | 46.26 | 89.04 | — | |
| EnergyBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 42.87 | 91.2 | 37.76 | 92.98 | 34.25 | 93.85 | 38.34 | 92.44 | 45.73 | 90.26 | 39.79 | 92.15 | — | |
| GradNormBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 49.6 | 80.45 | 82.23 | 59.6 | 78.17 | 63.55 | 81.7 | 59.72 | 82.93 | 58.05 | 74.93 | 64.27 | — | |
| ODINBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 50.74 | 92.09 | 39.82 | 92.62 | 33.34 | 94.17 | 36.53 | 93.18 | 45 | 91.11 | 41.09 | 92.63 | — | |
| RankfeatBackbone=WRN40, Pre-training loss=cross-entropy loss2023.11 | 60.02 | 72.03 | 72.33 | 63.24 | 52.17 | 83.24 | 78.43 | 61.27 | 86.22 | 51.97 | 69.83 | 66.35 | — | |
| MSPBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 61.03 | 89.01 | 53.11 | 85.79 | 46.79 | 90.63 | 43.71 | 91.88 | 48.28 | 90.08 | 50.58 | 89.48 | — | |
| GradNormBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 62.47 | 76.08 | 73 | 65.21 | 59.38 | 72.97 | 58.93 | 75.36 | 67.77 | 67.41 | 64.31 | 71.41 | — | |
| RankfeatBackbone=ResNet34, Pre-training loss=cross-entropy loss2023.11 | 84.58 | 72.99 | 50.2 | 89.84 | 41.63 | 91.97 | 67.79 | 82.64 | 68.12 | 80.67 | 62.46 | 83.62 | — | |
| FixMatchlabeled samples per class=100, supervision level=partial2021.05 | — | — | — | — | — | — | — | — | — | — | — | — | 60.4 | |
| Labeled Onlylabeled samples per class=100, supervision level=partial2021.05 | — | — | — | — | — | — | — | — | — | — | — | — | 64.7 | |
| MTClabeled samples per class=100, supervision level=partial2021.05 | — | — | — | — | — | — | — | — | — | — | — | — | 98.2 | |
| OpenMatchlabeled samples per class=100, supervision level=partial2021.05 | — | — | — | — | — | — | — | — | — | — | — | — | 99.7 | |
| Supervisedsupervision level=full2021.05 | — | — | — | — | — | — | — | — | — | — | — | — | 89.4 |