OOD Detection on ImageNet
96.22AUROCMDS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MDSBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 96.22 | — | — | — | |
| CLS-EBackbone=ViT-B/16, Evaluation Protocol=16-shot Prompt Learning2024.05 | 95.88 | — | — | — | |
| CLS-MBackbone=ViT-B/16, Evaluation Protocol=16-shot Prompt Learning2024.05 | 95.6 | — | — | — | |
| VIMBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 95.52 | — | — | — | |
| NAC-UEBackbone=ResNet-50, Layers=layer4+layer3+layer2, Preprocessing Time (s)=7.75 ± 0.2, Total Inference Time (s)=69.73 ± 0.42023.06 | 95.23 | — | — | — | |
| NAC-UEBackbone=ResNet-50, Layers=layer4+layer3, Preprocessing Time (s)=6.75 ± 0.3, Total Inference Time (s)=46.09 ± 0.72023.06 | 95.05 | — | — | — | |
| AdaNegBackbone=ViT-B/16, Evaluation Protocol=Zero-shot CLIP2024.05 | 94.87 | — | — | — | |
| NegLabelBackbone=ViT-B/16, Evaluation Protocol=Zero-shot CLIP2024.05 | 94.72 | — | — | — | |
| MaxLogitBackbone=ViT-B/16, Evaluation Protocol=16-shot Prompt Learning2024.05 | 94.66 | — | — | — | |
| EnergyBackbone=ViT-B/16, Evaluation Protocol=16-shot Prompt Learning2024.05 | 94.64 | — | — | — | |
| NAC-UEBackbone=ResNet-50, Layers=layer4, Preprocessing Time (s)=5.43 ± 0.3, Total Inference Time (s)=39.63 ± 0.22023.06 | 94.57 | — | — | — | |
| CLIPNBackbone=ViT-B/16, Evaluation Protocol=Zero-shot CLIP2024.05 | 94.17 | — | — | — | |
| LoCoOp (GL-MCM)Backbone=ViT-B/16, Evaluation Protocol=16-shot Prompt Learning2024.05 | 94.02 | — | — | — | |
| RMDSBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 93.87 | — | — | — | |
| ReactBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 92.94 | — | — | — | |
| ASHBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 92.84 | — | — | — | |
| KNNBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 92.84 | — | — | — | |
| ViMBackbone=ResNet-50, Preprocessing Time (s)=1087.82 ± 9.0, Total Inference Time (s)=48.10 ± 0.42023.06 | 92.68 | — | — | — | |
| NegPromptBackbone=ViT-B/16, Evaluation Protocol=16-shot Prompt Learning2024.05 | 92.6 | — | — | — | |
| ODINBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 92.34 | — | — | — | |
| SHEBackbone=ResNet-50, Preprocessing Time (s)=1019.34 ± 2.2, Total Inference Time (s)=41.85 ± 0.52023.06 | 90.92 | — | — | — | |
| SCALEBackbone=ResNet502026.03 | 90.42 | 34.02 | — | — | |
| GENBackbone=ResNet-50, Preprocessing Time (s)=0.00 ± 0.0, Total Inference Time (s)=43.33 ± 0.32023.06 | 89.76 | — | — | — | |
| ASH-SBackbone=ResNet502026.03 | 89.68 | 35.05 | — | — | |
| ASH-BBackbone=ResNet502026.03 | 88.75 | 37.11 | — | — | |
| GradNormBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 87.63 | — | — | — | |
| ReActBackbone=ResNet502026.03 | 87.15 | 42.46 | — | — | |
| RASBackbone=ResNet502026.03 | 86.55 | 40.92 | — | — | |
| MSPBackbone=ViT-B/16, Evaluation Protocol=Fully Fine-tuned2024.05 | 86.28 | — | — | — | |
| ASH-PBackbone=ResNet502026.03 | 85.44 | 46.04 | — | — | |
| RASBackbone=ConvNx-B2026.03 | 84.86 | 45.29 | — | — | |
| ReActBackbone=EffNet-B02026.03 | 84.27 | 49.01 | — | — | |
| EBOBackbone=ResNet502026.03 | 84.03 | 50.46 | — | — | |
| DICEBackbone=ResNet502026.03 | 83.8 | 54.07 | — | — | |
| RASBackbone=EffNet-B02026.03 | 83.78 | 46.87 | — | — | |
| RASBackbone=ConvNx-T2026.03 | 83.31 | 46.28 | — | — | |
| DivOEAuxiliary Outliers=w. Daux, Operation for Daux=Extrapolated2023.10 | 81.96 | 60.12 | 95.59 | 75.73 | |
| OEAuxiliary Outliers=w. Daux, Operation for Daux=Vanilla2023.10 | 81.58 | 61.94 | 95.49 | 75.9 | |
| RASBackbone=ViT-B/162026.03 | 81.48 | 55.19 | — | — | |
| ReActBackbone=ConvNx-B2026.03 | 80.85 | 64.06 | — | — | |
| ODINAuxiliary Outliers=w.o Daux, Operation for Daux=N/A2023.10 | 80.36 | 67.61 | 95.15 | 68.72 | |
| NTOMAuxiliary Outliers=w. Daux, Operation for Daux=Greedy Sampled2023.10 | 80.14 | 66.32 | 94.95 | 74.26 | |
| EnergyAuxiliary Outliers=w. Daux, Operation for Daux=Vanilla2023.10 | 79.93 | 66.94 | 94.9 | 74.19 | |
| EnergyAuxiliary Outliers=w.o Daux, Operation for Daux=N/A2023.10 | 79.52 | 71.44 | 94.98 | 68.72 | |
| POEMAuxiliary Outliers=w. Daux, Operation for Daux=Thompson Sampled2023.10 | 79.36 | 67.81 | 94.73 | 74.21 | |
| ReActBackbone=ViT-B/162026.03 | 79.12 | 66.15 | — | — | |
| VOSAuxiliary Outliers=w. Daux, Operation for Daux=Virtually Synthesized2023.10 | 78.97 | 74 | 94.82 | 76.15 | |
| MixOEAuxiliary Outliers=w. Daux, Operation for Daux=Mixup with ID Data2023.10 | 78.85 | 70.12 | 94.85 | 76.18 | |
| MCMBackbone=ViT-B/16, Evaluation Protocol=Zero-shot CLIP2024.05 | 78.38 | — | — | — | |
| ReActBackbone=ConvNx-T2026.03 | 77.87 | 69.45 | — | — | |
| ASHAuxiliary Outliers=w.o Daux, Operation for Daux=N/A2023.10 | 77.03 | 73.51 | 93.43 | 68.7 | |
| EBOBackbone=EffNet-B02026.03 | 76.76 | 72.29 | — | — | |
| MSPAuxiliary Outliers=w.o Daux, Operation for Daux=N/A2023.10 | 76.67 | 75.23 | 94.35 | 68.72 | |
| DICEBackbone=ViT-B/162026.03 | 75.53 | 65.23 | — | — | |
| EBOBackbone=ViT-B/162026.03 | 72.35 | 88.48 | — | — | |
| EBOBackbone=ConvNx-T2026.03 | 69.36 | 83.03 | — | — | |
| SCALEBackbone=ViT-B/162026.03 | 68.64 | 89.52 | — | — | |
| ASH-BBackbone=ConvNx-B2026.03 | 65.33 | 79.84 | — | — | |
| SCALEBackbone=ConvNx-B2026.03 | 65.22 | 76.53 | — | — | |
| ASH-PBackbone=EffNet-B02026.03 | 63.24 | 80.79 | — | — | |
| SCALEBackbone=ConvNx-T2026.03 | 60.1 | 84.32 | — | — | |
| EBOBackbone=ConvNx-B2026.03 | 59.36 | 93.29 | — | — | |
| SCALEBackbone=EffNet-B02026.03 | 59.05 | 79.7 | — | — | |
| MahalanobisAuxiliary Outliers=w.o Daux, Operation for Daux=N/A2023.10 | 58.47 | 83.41 | 87.72 | 68.72 | |
| DICEBackbone=ConvNx-B2026.03 | 58.1 | 95.3 | — | — | |
| DICEBackbone=ConvNx-T2026.03 | 57.78 | 93.86 | — | — | |
| ASH-SBackbone=EffNet-B02026.03 | 56.18 | 81.21 | — | — | |
| ASH-BBackbone=ViT-B/162026.03 | 52.57 | 95.51 | — | — | |
| ASH-BBackbone=EffNet-B02026.03 | 47.5 | 86.81 | — | — | |
| DICEBackbone=EffNet-B02026.03 | 43.32 | 91.33 | — | — | |
| ASH-SBackbone=ConvNx-T2026.03 | 32.59 | 97.64 | — | — | |
| ASH-PBackbone=ConvNx-T2026.03 | 31.68 | 99.26 | — | — | |
| ASH-BBackbone=ConvNx-T2026.03 | 31.01 | 98.05 | — | — | |
| ASH-SBackbone=ConvNx-B2026.03 | 26.86 | 99.67 | — | — | |
| ASH-SBackbone=ViT-B/162026.03 | 22.68 | 98.71 | — | — | |
| ASH-PBackbone=ViT-B/162026.03 | 22.32 | 98.74 | — | — | |
| ASH-PBackbone=ConvNx-B2026.03 | 16.89 | 99.8 | — | — |