Out-of-Distribution Detection on Average (iNaturalist, SUN, Places, Textures) (test)
90.11AUROCMOS
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MOSBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=3.2, Fine-tuned=true2021.05 | 90.11 | 39.97 | — | — | — | — | — | — | — | — | — | — | |
| RankFeatBackbone=SqueezeNet, Block=Block 3 + 42022.09 | 85.69 | 54.14 | — | — | — | — | — | — | — | — | — | — | |
| RankFeatBackbone=T2T-ViT-242022.09 | 85.6 | 51.58 | — | — | — | — | — | — | — | — | — | — | |
| RankFeatBackbone=SqueezeNet, Block=Block 42022.09 | 85.19 | 51.94 | — | — | — | — | — | — | — | — | — | — | |
| RankFeatBackbone=SqueezeNet, Block=Block 32022.09 | 84.28 | 58.33 | — | — | — | — | — | — | — | — | — | — | |
| KL MatchingBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=20.6, Fine-tuned=true2021.05 | 83.82 | 54.3 | — | — | — | — | — | — | — | — | — | — | |
| ReActBackbone=T2T-ViT-242022.09 | 83.55 | 59.72 | — | — | — | — | — | — | — | — | — | — | |
| MSPBackbone=T2T-ViT-242022.09 | 83.17 | 60.79 | — | — | — | — | — | — | — | — | — | — | |
| EnergyBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=3.1, Fine-tuned=true2021.05 | 82.74 | 71.03 | — | — | — | — | — | — | — | — | — | — | |
| ODINBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=23.6, Fine-tuned=true2021.05 | 82.56 | 72.99 | — | — | — | — | — | — | — | — | — | — | |
| ODINBackbone=T2T-ViT-242022.09 | 81.4 | 57.59 | — | — | — | — | — | — | — | — | — | — | |
| MSPBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=3.1, Fine-tuned=true2021.05 | 79.29 | 76.96 | — | — | — | — | — | — | — | — | — | — | |
| GradNormBackbone=SqueezeNet2022.09 | 78.21 | 66.16 | — | — | — | — | — | — | — | — | — | — | |
| EnergyBackbone=SqueezeNet2022.09 | 77.11 | 67.65 | — | — | — | — | — | — | — | — | — | — | |
| EnergyBackbone=T2T-ViT-242022.09 | 76.85 | 61.7 | — | — | — | — | — | — | — | — | — | — | |
| ReActBackbone=SqueezeNet2022.09 | 69.43 | 76.05 | — | — | — | — | — | — | — | — | — | — | |
| ODINBackbone=SqueezeNet2022.09 | 65.17 | 86.15 | — | — | — | — | — | — | — | — | — | — | |
| MahalanobisBackbone=BiT-S-R101x1, In-distribution dataset=ImageNet-1k, Test Time (min)=145.4, Fine-tuned=true2021.05 | 62.02 | 81.69 | — | — | — | — | — | — | — | — | — | — | |
| MSPBackbone=SqueezeNet2022.09 | 61.63 | 88.84 | — | — | — | — | — | — | — | — | — | — | |
| MahalanobisBackbone=T2T-ViT-242022.09 | 59.72 | 81.28 | — | — | — | — | — | — | — | — | — | — | |
| MahalanobisBackbone=SqueezeNet2022.09 | 59.44 | 83.17 | — | — | — | — | — | — | — | — | — | — | |
| GradNormBackbone=T2T-ViT-242022.09 | 29.61 | 97.34 | — | — | — | — | — | — | — | — | — | — | |
| EnergyBackbone=ViT-B/16, Zero-shot protocol=true2026.01 | — | — | 4.32 | 98.65 | 0.28 | 99.92 | 0.54 | 99.85 | 2.28 | 99.49 | 1.85 | 99.47 | |
| EOE+LLaVABackbone=ViT-B/16, Zero-shot protocol=true, L (Number of OOD label candidates)=4xK2026.01 | — | — | 5.65 | 98.28 | 0.53 | 99.85 | 1.04 | 99.74 | 0.84 | 99.8 | 2.02 | 99.42 | |
| EOE+LLaVABackbone=ViT-B/16, Zero-shot protocol=true, L (Number of OOD label candidates)=12xK2026.01 | — | — | 4.89 | 98.49 | 0.35 | 99.91 | 0.74 | 99.81 | 0.63 | 99.85 | 1.65 | 99.51 | |
| MaxLogitBackbone=ViT-B/16, Zero-shot protocol=true2026.01 | — | — | 4.17 | 98.69 | 0.22 | 99.95 | 0.48 | 99.87 | 1.49 | 99.67 | 1.59 | 99.54 | |
| MCMBackbone=ViT-B/16, Zero-shot protocol=true2026.01 | — | — | 14.51 | 96.43 | 2.44 | 99.48 | 3.63 | 99.21 | 2.78 | 99.45 | 5.84 | 98.64 | |
| Ours+LLaVABackbone=ViT-B/16, Zero-shot protocol=true, L (Number of OOD label candidates)=4xK2026.01 | — | — | 5.27 | 98.39 | 0.39 | 99.89 | 0.86 | 99.79 | 0.55 | 99.86 | 1.77 | 99.48 | |
| Ours+LLaVABackbone=ViT-B/16, Zero-shot protocol=true, L (Number of OOD label candidates)=12xK2026.01 | — | — | 4.33 | 98.6 | 0.32 | 99.92 | 0.69 | 99.83 | 0.4 | 99.9 | 1.43 | 99.56 |