Out-of-Distribution Detection on SUN (test)
40.63FPR@95MOS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MOSBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=3.2, Fine-tuned=true2021.05 | 40.63 | 92.01 | |
| RankFeatBackbone=SqueezeNet, Block=Block 3 + 42022.09 | 46.64 | 90.17 | |
| RankFeatBackbone=SqueezeNet, Block=Block 42022.09 | 46.72 | 88.31 | |
| KNN (non-parametric)Backbone=ViT-B/16, Fine-tuned on=ImageNet-1k2022.04 | 48.4 | — | |
| RankFeatBackbone=SqueezeNet, Block=Block 32022.09 | 49.18 | 90.18 | |
| GradNormBackbone=SqueezeNet2022.09 | 53.63 | 87.55 | |
| EnergyBackbone=SqueezeNet2022.09 | 56.41 | 87.88 | |
| RankFeatBackbone=T2T-ViT-242022.09 | 57.18 | 84.33 | |
| MSPBackbone=T2T-ViT-242022.09 | 61.77 | 81.37 | |
| ODINBackbone=T2T-ViT-242022.09 | 63.83 | 78.46 | |
| ReActBackbone=T2T-ViT-242022.09 | 65.23 | 81.03 | |
| EnergyBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=3.1, Fine-tuned=true2021.05 | 65.33 | 85.32 | |
| KL MatchingBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=20.6, Fine-tuned=true2021.05 | 67.52 | 78.72 | |
| EnergyBackbone=T2T-ViT-242022.09 | 68.55 | 73.06 | |
| ODINBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=23.6, Fine-tuned=true2021.05 | 71.67 | 83.92 | |
| ODINBackbone=SqueezeNet2022.09 | 78.32 | 78.37 | |
| MSPBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=3.1, Fine-tuned=true2021.05 | 79.98 | 78.34 | |
| Mahalanobis (parametric)Backbone=ViT-B/16, Fine-tuned on=ImageNet-1k2022.04 | 80.51 | — | |
| MSPBackbone=SqueezeNet2022.09 | 83.03 | 72.25 | |
| ReActBackbone=SqueezeNet2022.09 | 87.57 | 66.37 | |
| MahalanobisBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=145.4, Fine-tuned=true2021.05 | 88.43 | 65.2 | |
| MahalanobisBackbone=SqueezeNet2022.09 | 90.33 | 62.18 | |
| MahalanobisBackbone=T2T-ViT-242022.09 | 91.71 | 50.52 | |
| GradNormBackbone=T2T-ViT-242022.09 | 98.37 | 28.06 |