Out-of-Distribution Detection on ImageNet 1k (test)
94.28Average AUROCBATS
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| BATSBackbone=ResNet-50, Protocol=Post hoc2022.10 | 94.28 | 12.57 | 97.67 | 22.62 | 95.33 | 34.34 | 91.83 | 38.9 | 92.27 | 27.11 | |
| FA + FoBoRShots=16, Backbone=ViT-B/162026.01 | 93.81 | 15.52 | 96.45 | 28.85 | 93.24 | 30.55 | 92.56 | 29.52 | 93.02 | 26.11 | |
| Mambo + FoBoRShots=16, Backbone=ViT-B/162026.01 | 93.55 | 13.79 | 96.93 | 19.17 | 95.46 | 27.33 | 93.07 | 43.78 | 88.72 | 26.02 | |
| FAShots=16, Backbone=ViT-B/162026.01 | 93.54 | 16.24 | 96.19 | 29.56 | 93.07 | 32.66 | 92.17 | 30.79 | 92.72 | 27.31 | |
| SCT + FoBoRShots=16, Backbone=ViT-B/162026.01 | 93.34 | 17.6 | 96.16 | 19.59 | 95.57 | 28.74 | 92.59 | 43.32 | 89.05 | 27.31 | |
| LoCoOp + FoBoRShots=16, Backbone=ViT-B/162026.01 | 93.22 | 18.77 | 95.77 | 20.58 | 95.16 | 29.97 | 92.26 | 43.33 | 89.68 | 28.16 | |
| BATSBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 93.2 | 14.63 | 97.13 | 30.45 | 93.03 | 41.35 | 89.24 | 31.72 | 93.4 | 29.54 | |
| MamboShots=16, Backbone=ViT-B/162026.01 | 93.12 | 14.45 | 96.77 | 21.55 | 94.67 | 30.31 | 92.08 | 42.16 | 88.95 | 27.12 | |
| FA + FoBoRShots=1, Backbone=ViT-B/162026.01 | 93.02 | 15.81 | 96.37 | 31.88 | 92.34 | 33.45 | 91.64 | 34.03 | 91.73 | 28.79 | |
| ReActBackbone=ResNet-50, Protocol=Post hoc2022.10 | 92.95 | 17.77 | 96.7 | 25.15 | 94.34 | 34.64 | 91.92 | 51.31 | 88.83 | 32.22 | |
| LoCoOpShots=16, Backbone=ViT-B/162026.01 | 92.73 | 20.33 | 95.63 | 23.8 | 94.9 | 33.48 | 91.64 | 44.77 | 88.75 | 30.6 | |
| FAShots=1, Backbone=ViT-B/162026.01 | 92.72 | 15.93 | 96.32 | 32.74 | 92.26 | 35.47 | 91.03 | 35.52 | 91.26 | 29.91 | |
| SCTShots=16, Backbone=ViT-B/162026.01 | 92.44 | 16.19 | 96.32 | 24.3 | 94.14 | 32.37 | 91.57 | 44.15 | 87.72 | 29.25 | |
| LoCoOp + FoBoRShots=1, Backbone=ViT-B/162026.01 | 92.2 | 27.85 | 94.42 | 25.29 | 94.72 | 34.31 | 91.48 | 47.93 | 88.17 | 33.84 | |
| Mambo + FoBoRShots=1, Backbone=ViT-B/162026.01 | 92.2 | 20.69 | 95.62 | 24.07 | 94.51 | 32.42 | 91.66 | 48.72 | 87 | 31.48 | |
| ReActBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 91.88 | 15.93 | 96.91 | 40.41 | 90.13 | 48.87 | 87.98 | 36.58 | 92.48 | 35.45 | |
| CoOpMCMShots=16, Backbone=ViT-B/162026.01 | 91.78 | 27.96 | 94.29 | 35.21 | 92.46 | 41.39 | 90.17 | 42.23 | 90.18 | 36.7 | |
| CoOpGLShots=16, Backbone=ViT-B/162026.01 | 91.54 | 14.55 | 96.75 | 28.2 | 92.73 | 35.36 | 90.35 | 46.69 | 86.31 | 31.2 | |
| SCT + FoBoRShots=1, Backbone=ViT-B/162026.01 | 91.53 | 30.59 | 93.41 | 26.05 | 93.98 | 34.56 | 91.09 | 47.71 | 87.63 | 34.73 | |
| LoCoOpShots=1, Backbone=ViT-B/162026.01 | 90.98 | 22.74 | 95.08 | 29.61 | 93.25 | 38.04 | 89.95 | 51.42 | 85.64 | 35.45 | |
| GL-MCMShots=0, Backbone=ViT-B/162026.01 | 90.83 | 15.18 | 96.71 | 30.42 | 93.09 | 38.85 | 89.9 | 57.93 | 83.63 | 35.47 | |
| MamboShots=1, Backbone=ViT-B/162026.01 | 90.8 | 23.15 | 94.98 | 28.86 | 93.34 | 36.59 | 90.35 | 51.84 | 84.53 | 35.11 | |
| MCMShots=0, Backbone=ViT-B/162026.01 | 90.76 | 30.94 | 94.61 | 37.67 | 92.56 | 44.76 | 89.76 | 57.91 | 86.1 | 42.82 | |
| BATSBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 90.39 | 31.56 | 94.33 | 41.68 | 90.21 | 52.43 | 86.26 | 38.69 | 90.76 | 41.09 | |
| CoOpGLShots=1, Backbone=ViT-B/162026.01 | 89.8 | 30.48 | 93.15 | 33.05 | 92.02 | 40.29 | 89.53 | 52.44 | 84.51 | 39.07 | |
| SCTShots=1, Backbone=ViT-B/162026.01 | 89.65 | 22.91 | 94.82 | 34.07 | 91.86 | 41.79 | 89.03 | 55.83 | 82.89 | 38.65 | |
| CoOpMCMShots=1, Backbone=ViT-B/162026.01 | 89.27 | 53.49 | 88.92 | 42.29 | 91.46 | 47.77 | 89.01 | 50.76 | 87.69 | 48.58 | |
| GradNormBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 89.26 | 33.7 | 92.46 | 42.15 | 89.65 | 56.56 | 83.93 | 34.95 | 90.99 | 41.84 | |
| ASH-B@90Model=DenseNet-1212022.09 | 89.15 | — | — | — | — | — | — | — | — | 45.38 | |
| MOOD2023.02 | 89.1 | — | 86.9 | — | 89.8 | — | 88.5 | — | 91.3 | — | |
| ASH-B@65Model=VGG-162022.09 | 89.01 | — | — | — | — | — | — | — | — | 42.52 | |
| ASH-S@95Model=VGG-162022.09 | 88.91 | — | — | — | — | — | — | — | — | 54.63 | |
| ASH-S@90Model=DenseNet-1212022.09 | 88.79 | — | — | — | — | — | — | — | — | 46.5 | |
| ReActBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 88.05 | 37.08 | 93.41 | 53.13 | 86.04 | 54.15 | 83.31 | 42.45 | 89.42 | 46.7 | |
| ASH-S@99Model=VGG-162022.09 | 87.79 | — | — | — | — | — | — | — | — | 49.46 | |
| GradNormBackbone=ResNet-50, Protocol=Post hoc2022.10 | 87.7 | 23.73 | 93.97 | 42.81 | 87.26 | 55.62 | 81.85 | 38.15 | 87.73 | 40.08 | |
| GradNormBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 87.28 | 22.88 | 94.4 | 43.12 | 87.55 | 55.8 | 82 | 47.58 | 85.16 | 42.35 | |
| EnergyBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 87.1 | 33.16 | 93.81 | 53.79 | 86.7 | 61.01 | 83.83 | 55.42 | 84.06 | 50.85 | |
| ODINBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 86.8 | 30.72 | 93.66 | 57.9 | 86.11 | 63.16 | 83.54 | 53.51 | 83.88 | 51.32 | |
| GradNormSOTA=true2023.02 | 86.3 | — | 90.3 | — | 89 | — | 84.8 | — | 81.1 | — | |
| ODINBackbone=ResNet-50, Protocol=Post hoc2022.10 | 85.94 | 41.07 | 91.32 | 64.63 | 84.71 | 68.36 | 81.95 | 50.55 | 85.77 | 56.15 | |
| ASH-S@90Model=VGG-162022.09 | 85.92 | — | — | — | — | — | — | — | — | 61.58 | |
| EnergyBackbone=ResNet-50, Protocol=Post hoc2022.10 | 85.82 | 46.65 | 91.32 | 61.96 | 84.88 | 67.97 | 82.21 | 56.06 | 84.88 | 58.16 | |
| EnergyBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 85.46 | 49.52 | 91.1 | 63.06 | 84.42 | 69.24 | 81.42 | 53.77 | 85.16 | 58.9 | |
| ODINBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 85.31 | 45.61 | 91.33 | 63.03 | 83.44 | 70.01 | 80.85 | 52.45 | 85.61 | 57.78 | |
| Energy scoreModel=DenseNet-1212022.09 | 85.17 | — | — | — | — | — | — | — | — | 57.84 | |
| ASH-B@65Model=DenseNet-1212022.09 | 84.9 | — | — | — | — | — | — | — | — | 55.09 | |
| Energy scoreModel=VGG-162022.09 | 84.83 | — | — | — | — | — | — | — | — | 64.2 | |
| Energy2023.02 | 82.7 | — | 88.5 | — | 85.3 | — | 81.4 | — | 75.8 | — | |
| ODIN2023.02 | 82.6 | — | 89.4 | — | 83.9 | — | 80.7 | — | 76.3 | — | |
| MSPBackbone=ResNet-50, Protocol=Post hoc2022.10 | 81.41 | 51.44 | 88.17 | 72.04 | 79.95 | 74.34 | 78.84 | 54.9 | 78.69 | 63.18 | |
| MSPBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 81.13 | 47.65 | 89.09 | 69.95 | 79.64 | 72.53 | 78.74 | 69.69 | 77.06 | 64.96 | |
| MahalanobisBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 80.56 | 62.04 | 82.37 | 54.79 | 86.33 | 83.69 | 88.72 | 37.28 | 64.83 | 59.45 | |
| Baseline OOD2023.02 | 79.3 | — | 87.6 | — | 78.3 | — | 76.8 | — | 74.5 | — | |
| MSPBackbone=MobileNet-V2, Protocol=Post hoc2022.10 | 78.43 | 63.09 | 85.71 | 79.67 | 76.01 | 81.47 | 75.12 | 76.49 | 74.84 | 75.18 | |
| Mahalanobis2023.02 | 62 | — | 46.3 | — | 65.2 | — | 64.5 | — | 72.1 | — | |
| MahalanobisBackbone=ResNet-50, Protocol=Post hoc2022.10 | 55.47 | 97 | 52.65 | 98.5 | 42.41 | 98.4 | 41.79 | 55.8 | 85.01 | 87.43 | |
| MahalanobisBackbone=DenseNet-121, Protocol=Post hoc2022.10 | 46.83 | 97.36 | 42.24 | 96.21 | 41.28 | 97.32 | 47.27 | 62.78 | 56.53 | 88.42 |