List your company
ResearchFormerly WizWand

Out-of-Distribution Detection on ImageNet-1k vs iNaturalist (test)

18.64FPR@95DICE + ReAct
15.505636.662857.8278.9772Nov 18, 2021Mar 19, 2022Jul 18, 2022Nov 17, 2022Mar 18, 2023Jul 17, 2023Nov 16, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DICE + ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1118.6496.24
ReActBackbone=ResNet-502021.1120.3896.22
ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1120.3896.22
ASH-B@90Methods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.1122.2296.15
DICEBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1125.6394.49
GAIA-AMethods Space=Gradient, Backbone=Google BiT-S, Blocks=Block4, Post-hoc=true2023.1129.4793.52
WordMethod Category=Textual OE, Level=Word2023.1032.6594.42
CaptionMethod Category=Textual OE, Level=Caption2023.1032.9194.55
RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block3+4, Post-hoc=true2023.1141.3191.91
ReActBackbone=MobileNet2021.1142.491.53
ReActMethods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.1144.5291.81
Desc.Method Category=Textual OE, Level=Description2023.1046.0992.07
RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block4, Post-hoc=true2023.1146.5481.49
ODINBackbone=ResNet-502021.1147.6689.66
ODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1147.6689.66
GradNormMethods Space=Gradient, Backbone=Google BiT-S, Post-hoc=true2023.1150.0390.33
MSPBackbone=ResNet-502021.1154.9987.74
MSPBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1154.9987.74
ODINBackbone=MobileNet2021.1155.3987.62
EnergyBackbone=ResNet-502021.1155.7289.95
EnergyBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1155.7289.95
ReActMethod Category=Post-hoc2023.1056.1184.94
KNNMethods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.1159.0886.2
EnergyBackbone=MobileNet2021.1159.588.91
GODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1161.9185.4
MahalanobisBackbone=MobileNet2021.1162.1181
ODINMethods Space=Output, Backbone=Google BiT-S, Post-hoc=true2023.1162.6989.36
MSPMethods Space=Output, Backbone=Google BiT-S, Post-hoc=true2023.1163.6987.59
ODINMethod Category=Post-hoc2023.1063.8577.78
MSPBackbone=MobileNet2021.1164.2985.32
EnergyMethods Space=Output, Backbone=Google BiT-S, Post-hoc=true2023.1164.9188.48
GAIA-ZMethods Space=Gradient, Backbone=Google BiT-S, Blocks=Block4, Post-hoc=true2023.1165.0984.15
KNNMethod Category=Post-hoc2023.1065.483.73
EnergyMethod Category=Post-hoc2023.1069.177.39
MSPMethod Category=Post-hoc2023.1072.9877.22
MahalanobisMethod Category=Post-hoc2023.1095.960.56
MahalanobisMethods Space=Feature, Backbone=Google BiT-S, Post-hoc=true2023.1196.3446.33
MahalanobisBackbone=ResNet-502021.119752.65
MahalanobisBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.119752.65