List your company
ResearchFormerly WizWand

Out-of-distribution Detection on ImageNet-1k vs Textures (test)

11.19FPR95GradOrth
7.942429.863751.78573.7063Nov 18, 2021Mar 19, 2022Jul 18, 2022Nov 17, 2022Mar 18, 2023Jul 17, 2023Nov 16, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GradOrthBackbone=ResNet2023.0811.1998.06
GAIA-ZMethods Space=Gradient, Backbone=Google BiT-S2023.1111.3297.93
KNNMethods Space=Feature, Backbone=Google BiT-S2023.1111.5697.18
ASH-SBackbone=ResNet2023.0811.9397.6
GradOrthBackbone=MobileNet2023.0812.6997.52
ASH-SBackbone=MobileNet2023.0813.1297.1
DICE + ReActBackbone=MobileNet2023.0816.2896.25
ASH-BBackbone=MobileNet2023.0820.9295.07
ASH-BBackbone=ResNet2023.0821.1795.5
VRA-PBackbone=ResNet2023.0821.4795.62
ASH-B@90Methods Space=Feature, Backbone=Google BiT-S2023.1123.3395.43
VRA-DNBackbone=ResNet2023.0826.7295.04
DICE + ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1128.0792.74
DICE + ReActBackbone=ResNet2023.0828.0792.74
DICEBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1131.7290.3
DICEBackbone=ResNet2023.0831.7290.3
DICEBackbone=MobileNet2023.0832.891.3
GradNormBackbone=ResNet2023.0834.4888.43
RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block3+42023.1137.2991.7
ExGradBackbone=ResNet2023.0838.1279.37
ReActBackbone=MobileNet2021.1138.4291.53
ReActBackbone=MobileNet2023.0838.4291.53
GAIA-AMethods Space=Gradient, Backbone=Google BiT-S2023.1140.4192.71
KNNMethod Category=Post-hoc2023.1040.886.45
ASH-PBackbone=ResNet2023.0842.0689.7
RankfeatMethods Space=Feature, Backbone=Google BiT-S, Blocks=Block42023.1146.0689.33
ReActBackbone=ResNet-502021.1147.389.8
ReActBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1147.389.8
ReActBackbone=ResNet2023.0847.389.8
ASH-PBackbone=MobileNet2023.0848.4888.72
ODINBackbone=MobileNet2021.1149.9685.03
ODINBackbone=MobileNet2023.0849.9685.03
ODINBackbone=ResNet-502021.1150.2385.62
ODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1150.2385.62
ODINBackbone=ResNet2023.0850.2385.62
MahalanobisMethods Space=Feature, Backbone=Google BiT-S2023.1152.2372.1
EnergyBackbone=ResNet-502021.1153.7285.99
EnergyBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1153.7285.99
Energy scoreBackbone=ResNet2023.0853.7285.99
MahalanobisBackbone=ResNet-502021.1155.885.01
MahalanobisBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1155.885.01
MahalanobisBackbone=ResNet2023.0855.885.01
MahalanobisMethod Category=Post-hoc2023.1055.884.6
EnergyMethod Category=Post-hoc2023.1056.9784.32
EnergyBackbone=MobileNet2021.1158.0585.03
Energy scoreBackbone=MobileNet2023.0858.0585.03
GradNormMethods Space=Gradient, Backbone=Google BiT-S2023.1161.4281.07
ODINMethod Category=Post-hoc2023.1067.8777.4
MSPBackbone=ResNet-502021.116879.61
MSPBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.116879.61
Softmax scoreBackbone=ResNet2023.086879.61
ReActMethod Category=Post-hoc2023.1070.2782.16
MSPMethod Category=Post-hoc2023.1070.7378.58
ReActMethods Space=Feature, Backbone=Google BiT-S2023.1170.7376.85
MSPBackbone=MobileNet2021.1173.5177.3
Softmax scoreBackbone=MobileNet2023.0873.5177.3
Desc.Method Category=Textual OE, Level=Description2023.1073.6279.77
CaptionMethod Category=Textual OE, Level=Caption2023.1074.2979.48
WordMethod Category=Textual OE, Level=Word2023.1076.0878.8
GODINBackbone=ResNet-50, Pre-trained=ImageNet-1k2021.1177.8573.27
EnergyMethods Space=Output, Backbone=Google BiT-S2023.1180.8775.79
ODINMethods Space=Output, Backbone=Google BiT-S2023.1181.3176.3
MSPMethods Space=Output, Backbone=Google BiT-S2023.1182.7374.45
MahalanobisBackbone=MobileNet2021.1192.3833.06
MahalanobisBackbone=MobileNet2023.0892.3833.06