Out-of-Distribution Detection on ImageNet-1k vs iNaturalist (test)
18.64FPR@95DICE + ReAct
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DICE + ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 18.64 | 96.24 | |
| ReActBackbone=ResNet-502021.11 | 20.38 | 96.22 | |
| ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 20.38 | 96.22 | |
| ASH-B@90Methods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.11 | 22.22 | 96.15 | |
| DICEBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 25.63 | 94.49 | |
| GAIA-AMethods Space=Gradient, Backbone=Google BiT-S, Blocks=Block4, Post-hoc=true2023.11 | 29.47 | 93.52 | |
| WordMethod Category=Textual OE, Level=Word2023.10 | 32.65 | 94.42 | |
| CaptionMethod Category=Textual OE, Level=Caption2023.10 | 32.91 | 94.55 | |
| RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block3+4, Post-hoc=true2023.11 | 41.31 | 91.91 | |
| ReActBackbone=MobileNet2021.11 | 42.4 | 91.53 | |
| ReActMethods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.11 | 44.52 | 91.81 | |
| Desc.Method Category=Textual OE, Level=Description2023.10 | 46.09 | 92.07 | |
| RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block4, Post-hoc=true2023.11 | 46.54 | 81.49 | |
| ODINBackbone=ResNet-502021.11 | 47.66 | 89.66 | |
| ODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 47.66 | 89.66 | |
| GradNormMethods Space=Gradient, Backbone=Google BiT-S, Post-hoc=true2023.11 | 50.03 | 90.33 | |
| MSPBackbone=ResNet-502021.11 | 54.99 | 87.74 | |
| MSPBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 54.99 | 87.74 | |
| ODINBackbone=MobileNet2021.11 | 55.39 | 87.62 | |
| EnergyBackbone=ResNet-502021.11 | 55.72 | 89.95 | |
| EnergyBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 55.72 | 89.95 | |
| ReActMethod Category=Post-hoc2023.10 | 56.11 | 84.94 | |
| KNNMethods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.11 | 59.08 | 86.2 | |
| EnergyBackbone=MobileNet2021.11 | 59.5 | 88.91 | |
| GODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 61.91 | 85.4 | |
| MahalanobisBackbone=MobileNet2021.11 | 62.11 | 81 | |
| ODINMethods Space=Output, Backbone=Google BiT-S, Post-hoc=true2023.11 | 62.69 | 89.36 | |
| MSPMethods Space=Output, Backbone=Google BiT-S, Post-hoc=true2023.11 | 63.69 | 87.59 | |
| ODINMethod Category=Post-hoc2023.10 | 63.85 | 77.78 | |
| MSPBackbone=MobileNet2021.11 | 64.29 | 85.32 | |
| EnergyMethods Space=Output, Backbone=Google BiT-S, Post-hoc=true2023.11 | 64.91 | 88.48 | |
| GAIA-ZMethods Space=Gradient, Backbone=Google BiT-S, Blocks=Block4, Post-hoc=true2023.11 | 65.09 | 84.15 | |
| KNNMethod Category=Post-hoc2023.10 | 65.4 | 83.73 | |
| EnergyMethod Category=Post-hoc2023.10 | 69.1 | 77.39 | |
| MSPMethod Category=Post-hoc2023.10 | 72.98 | 77.22 | |
| MahalanobisMethod Category=Post-hoc2023.10 | 95.9 | 60.56 | |
| MahalanobisMethods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.11 | 96.34 | 46.33 | |
| MahalanobisBackbone=ResNet-502021.11 | 97 | 52.65 | |
| MahalanobisBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 97 | 52.65 |