Out-of-Distribution Detection on Places with ImageNet-1k OOD In-distribution (test)
32.25FPR95Energy
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EnergyBackbone=CLIP-L, Training Protocol=Fine-tuned2022.11 | 32.25 | 93.01 | |
| ASH-BBackbone=ResNet2023.08 | 33.45 | 92.31 | |
| GradOrthBackbone=ResNet2023.08 | 33.67 | 91.78 | |
| ReActBackbone=ResNet-502021.11 | 33.85 | 91.58 | |
| ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 33.85 | 91.58 | |
| ReActBackbone=ResNet2023.08 | 33.85 | 91.58 | |
| MCMBackbone=CLIP-L, Training Protocol=Zero-shot2022.11 | 35.42 | 92 | |
| EnergyBackbone=CLIP-B, Training Protocol=Fine-tuned2022.11 | 36.64 | 91.82 | |
| DICE + ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 36.86 | 90.67 | |
| DICE + ReActBackbone=ResNet2023.08 | 36.86 | 90.67 | |
| VRA-PBackbone=ResNet2023.08 | 37.85 | 91.27 | |
| RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block42023.11 | 38.26 | 88.34 | |
| RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block3+42023.11 | 39.34 | 90.93 | |
| KNNIn-distribution image requirement=Required2024.09 | 39.61 | 91.02 | |
| ASH-SBackbone=ResNet2023.08 | 39.78 | 90.98 | |
| VRA-DNBackbone=ResNet2023.08 | 39.94 | 90.75 | |
| GradOrthBackbone=MobileNet2023.08 | 40.27 | 89.12 | |
| EnergyIn-distribution image requirement=Not required2024.09 | 40.29 | 89.32 | |
| MaxLogitIn-distribution image requirement=Not required2024.09 | 41.15 | 89.6 | |
| GradNormBackbone=ResNet2023.08 | 43.48 | 80.64 | |
| HFTTIn-distribution image requirement=Not required2024.09 | 43.54 | 90.26 | |
| MCMBackbone=CLIP-B, Training Protocol=Zero-shot2022.11 | 44.69 | 89.77 | |
| NPOSIn-distribution image requirement=Required2024.09 | 45.27 | 89.44 | |
| DICEBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 46.49 | 87.48 | |
| DICEBackbone=ResNet2023.08 | 46.49 | 87.48 | |
| DICE + ReActBackbone=MobileNet2023.08 | 46.78 | 88.02 | |
| MCMIn-distribution image requirement=Not required2024.09 | 47.48 | 88.68 | |
| ASH-B@90Methods Space=Feature, Backbone=Google BiT-S2023.11 | 47.73 | 89.61 | |
| GAIA-AMethods Space=Gradient, Backbone=Google BiT-S2023.11 | 48.55 | 88.94 | |
| MOSBackbone=BiT, Training Protocol=Fine-tuned2022.11 | 49.54 | 89.06 | |
| ExGradBackbone=ResNet2023.08 | 50.62 | 74.27 | |
| ReActBackbone=MobileNet2021.11 | 51.56 | 86.64 | |
| ReActBackbone=MobileNet2023.08 | 51.56 | 86.64 | |
| ASH-BBackbone=MobileNet2023.08 | 51.8 | 87.56 | |
| MahalanobisBackbone=MobileNet2021.11 | 52.09 | 81.65 | |
| MahalanobisBackbone=MobileNet2023.08 | 52.09 | 83.63 | |
| DICEBackbone=MobileNet2023.08 | 53.11 | 85.81 | |
| ReActBackbone=ResNet-502026.02 | 54.5 | 87.9 | |
| Fort et al.Backbone=ViT-L, Training Protocol=Fine-tuned2022.11 | 55.14 | 86.48 | |
| ODINBackbone=MobileNet2021.11 | 57.36 | 84.71 | |
| ODINBackbone=MobileNet2023.08 | 57.36 | 84.71 | |
| Fort et al.Backbone=ViT-B, Training Protocol=Fine-tuned2022.11 | 57.99 | 85.24 | |
| ASH-SBackbone=MobileNet2023.08 | 58.84 | 84.73 | |
| MSPBackbone=CLIP-L, Training Protocol=Fine-tuned2022.11 | 59.86 | 84.1 | |
| GradNormMethod Space=Gradient, Backbone=ResNetv2-101, Pre-trained on=ImageNet-1k, Input Resolution=480x4802021.10 | 60.86 | 84.82 | |
| GradNormMethods Space=Gradient, Backbone=Google BiT-S2023.11 | 60.86 | 84.82 | |
| ASH-PBackbone=ResNet2023.08 | 61.79 | 85.58 | |
| ReActMethods Space=Feature, Backbone=Google BiT-S2023.11 | 62.66 | 87.83 | |
| MSPIn-distribution image requirement=Required2024.09 | 63.5 | 80.19 | |
| GODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 63.7 | 83.81 | |
| EnergyBackbone=ResNet-502021.11 | 64.92 | 82.86 | |
| EnergyBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 64.92 | 82.86 | |
| Energy scoreBackbone=ResNet2023.08 | 64.92 | 82.86 | |
| ASH-PBackbone=MobileNet2023.08 | 66.59 | 83.47 | |
| EnergyBackbone=ResNet-502026.02 | 66.6 | 83.8 | |
| MaxLogitBackbone=ResNet-502026.02 | 66.7 | 83.8 | |
| FDBDBackbone=ResNet-502026.02 | 67.8 | 83.7 | |
| ODINBackbone=ResNet-502021.11 | 67.89 | 81.78 | |
| ODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 67.89 | 81.78 | |
| ODINBackbone=ResNet2023.08 | 67.89 | 81.78 | |
| MSPBackbone=CLIP-B, Training Protocol=Fine-tuned2022.11 | 67.9 | 80.14 | |
| EnergyBackbone=MobileNet2021.11 | 69.37 | 81.19 | |
| Energy scoreBackbone=MobileNet2023.08 | 69.37 | 81.19 | |
| CaptionMethod Category=Textual OE, Level=Caption2023.10 | 70.54 | 81.51 | |
| GAIA-ZMethods Space=Gradient, Backbone=Google BiT-S2023.11 | 71.02 | 81.16 | |
| WordMethod Category=Textual OE, Level=Word2023.10 | 71.06 | 81.65 | |
| MSPBackbone=ResNet-502026.02 | 72.9 | 80.4 | |
| EnergyMethod Space=Output, Backbone=ResNetv2-101, Pre-trained on=ImageNet-1k, Input Resolution=480x4802021.10 | 73.02 | 81.37 | |
| EnergyMethods Space=Output, Backbone=Google BiT-S2023.11 | 73.02 | 81.37 | |
| ZOCIn-distribution image requirement=Not required2024.09 | 73.06 | 83.39 | |
| MSPBackbone=ResNet-502021.11 | 73.99 | 79.76 | |
| MSPBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 73.99 | 79.76 | |
| Softmax scoreBackbone=ResNet2023.08 | 73.99 | 79.76 | |
| D-KNNBackbone=ResNet-502026.02 | 74.8 | 76.7 | |
| ReActMethod Category=Post-hoc2023.10 | 75 | 80.72 | |
| EnergyMethod Category=Post-hoc2023.10 | 76.15 | 80.23 | |
| ODINMethod Space=Output, Backbone=ResNetv2-101, Pre-trained on=ImageNet-1k, Input Resolution=480x4802021.10 | 76.27 | 80.67 | |
| ODINMethods Space=Output, Backbone=Google BiT-S2023.11 | 76.27 | 80.67 | |
| MSPMethod Category=Post-hoc2023.10 | 76.69 | 77.81 | |
| KNNMethods Space=Feature, Backbone=Google BiT-S2023.11 | 77.09 | 74.87 | |
| KNNMethod Category=Post-hoc2023.10 | 79.2 | 74.34 | |
| MSPBackbone=MobileNet2021.11 | 79.23 | 76.27 | |
| Softmax scoreBackbone=MobileNet2023.08 | 79.23 | 76.27 | |
| KNNBackbone=ResNet-502026.02 | 80 | 73.6 | |
| Desc.Method Category=Textual OE, Level=Description2023.10 | 81.28 | 77.4 | |
| MSPMethod Space=Output, Backbone=ResNetv2-101, Pre-trained on=ImageNet-1k, Input Resolution=480x4802021.10 | 81.44 | 76.76 | |
| MSPMethods Space=Output, Backbone=Google BiT-S2023.11 | 81.44 | 76.76 | |
| ViMBackbone=ResNet-502026.02 | 83.8 | 77.9 | |
| ODINMethod Category=Post-hoc2023.10 | 88 | 67.17 | |
| NecoBackbone=ResNet-502026.02 | 88.6 | 66.3 | |
| MahalanobisMethod Space=Feature, Backbone=ResNetv2-101, Pre-trained on=ImageNet-1k, Input Resolution=480x4802021.10 | 89.75 | 64.46 | |
| MahalanobisMethods Space=Feature, Backbone=Google BiT-S2023.11 | 89.75 | 64.46 | |
| WDiscOODBackbone=ResNet-502026.02 | 96.8 | 53.7 | |
| MahalanobisBackbone=ResNet-502026.02 | 97.5 | 51 | |
| MahalanobisBackbone=ResNet-502021.11 | 98.4 | 41.79 | |
| MahalanobisBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.11 | 98.4 | 41.79 | |
| MahalanobisBackbone=ResNet2023.08 | 98.4 | 41.79 | |
| MahalanobisIn-distribution image requirement=Required2024.09 | 98.54 | 65.96 | |
| MahalanobisMethod Category=Post-hoc2023.10 | 98.9 | 44.65 |