Out-of-distribution Detection on ImageNet-1k vs Textures (test)
11.19FPR95GradOrth
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GradOrthBackbone=ResNet2023.08 | 11.19 | 98.06 | |
| GAIA-ZMethods Space=Gradient, Backbone=Google BiT-S2023.11 | 11.32 | 97.93 | |
| KNNMethods Space=Feature, Backbone=Google BiT-S2023.11 | 11.56 | 97.18 | |
| ASH-SBackbone=ResNet2023.08 | 11.93 | 97.6 | |
| GradOrthBackbone=MobileNet2023.08 | 12.69 | 97.52 | |
| ASH-SBackbone=MobileNet2023.08 | 13.12 | 97.1 | |
| DICE + ReActBackbone=MobileNet2023.08 | 16.28 | 96.25 | |
| ASH-BBackbone=MobileNet2023.08 | 20.92 | 95.07 | |
| ASH-BBackbone=ResNet2023.08 | 21.17 | 95.5 | |
| VRA-PBackbone=ResNet2023.08 | 21.47 | 95.62 | |
| ASH-B@90Methods Space=Feature, Backbone=Google BiT-S2023.11 | 23.33 | 95.43 | |
| VRA-DNBackbone=ResNet2023.08 | 26.72 | 95.04 | |
| DICE + ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 28.07 | 92.74 | |
| DICE + ReActBackbone=ResNet2023.08 | 28.07 | 92.74 | |
| DICEBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 31.72 | 90.3 | |
| DICEBackbone=ResNet2023.08 | 31.72 | 90.3 | |
| DICEBackbone=MobileNet2023.08 | 32.8 | 91.3 | |
| GradNormBackbone=ResNet2023.08 | 34.48 | 88.43 | |
| RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block3+42023.11 | 37.29 | 91.7 | |
| ExGradBackbone=ResNet2023.08 | 38.12 | 79.37 | |
| ReActBackbone=MobileNet2021.11 | 38.42 | 91.53 | |
| ReActBackbone=MobileNet2023.08 | 38.42 | 91.53 | |
| GAIA-AMethods Space=Gradient, Backbone=Google BiT-S2023.11 | 40.41 | 92.71 | |
| KNNMethod Category=Post-hoc2023.10 | 40.8 | 86.45 | |
| ASH-PBackbone=ResNet2023.08 | 42.06 | 89.7 | |
| RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block42023.11 | 46.06 | 89.33 | |
| ReActBackbone=ResNet-502021.11 | 47.3 | 89.8 | |
| ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 47.3 | 89.8 | |
| ReActBackbone=ResNet2023.08 | 47.3 | 89.8 | |
| ASH-PBackbone=MobileNet2023.08 | 48.48 | 88.72 | |
| ODINBackbone=MobileNet2021.11 | 49.96 | 85.03 | |
| ODINBackbone=MobileNet2023.08 | 49.96 | 85.03 | |
| ODINBackbone=ResNet-502021.11 | 50.23 | 85.62 | |
| ODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 50.23 | 85.62 | |
| ODINBackbone=ResNet2023.08 | 50.23 | 85.62 | |
| MahalanobisMethods Space=Feature, Backbone=Google BiT-S2023.11 | 52.23 | 72.1 | |
| EnergyBackbone=ResNet-502021.11 | 53.72 | 85.99 | |
| EnergyBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 53.72 | 85.99 | |
| Energy scoreBackbone=ResNet2023.08 | 53.72 | 85.99 | |
| MahalanobisBackbone=ResNet-502021.11 | 55.8 | 85.01 | |
| MahalanobisBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 55.8 | 85.01 | |
| MahalanobisBackbone=ResNet2023.08 | 55.8 | 85.01 | |
| MahalanobisMethod Category=Post-hoc2023.10 | 55.8 | 84.6 | |
| EnergyMethod Category=Post-hoc2023.10 | 56.97 | 84.32 | |
| EnergyBackbone=MobileNet2021.11 | 58.05 | 85.03 | |
| Energy scoreBackbone=MobileNet2023.08 | 58.05 | 85.03 | |
| GradNormMethods Space=Gradient, Backbone=Google BiT-S2023.11 | 61.42 | 81.07 | |
| ODINMethod Category=Post-hoc2023.10 | 67.87 | 77.4 | |
| MSPBackbone=ResNet-502021.11 | 68 | 79.61 | |
| MSPBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 68 | 79.61 | |
| Softmax scoreBackbone=ResNet2023.08 | 68 | 79.61 | |
| ReActMethod Category=Post-hoc2023.10 | 70.27 | 82.16 | |
| MSPMethod Category=Post-hoc2023.10 | 70.73 | 78.58 | |
| ReActMethods Space=Feature, Backbone=Google BiT-S2023.11 | 70.73 | 76.85 | |
| MSPBackbone=MobileNet2021.11 | 73.51 | 77.3 | |
| Softmax scoreBackbone=MobileNet2023.08 | 73.51 | 77.3 | |
| Desc.Method Category=Textual OE, Level=Description2023.10 | 73.62 | 79.77 | |
| CaptionMethod Category=Textual OE, Level=Caption2023.10 | 74.29 | 79.48 | |
| WordMethod Category=Textual OE, Level=Word2023.10 | 76.08 | 78.8 | |
| GODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 77.85 | 73.27 | |
| EnergyMethods Space=Output, Backbone=Google BiT-S2023.11 | 80.87 | 75.79 | |
| ODINMethods Space=Output, Backbone=Google BiT-S2023.11 | 81.31 | 76.3 | |
| MSPMethods Space=Output, Backbone=Google BiT-S2023.11 | 82.73 | 74.45 | |
| MahalanobisBackbone=MobileNet2021.11 | 92.38 | 33.06 | |
| MahalanobisBackbone=MobileNet2023.08 | 92.38 | 33.06 |