Out-of-distribution Detection on SVHN
99.8AUROCCSI
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CSINetwork=ResNet-182020.07 | 99.8 | — | — | — | |
| RODDID dataset=CIFAR-102022.04 | 99.63 | — | 1.82 | — | |
| FSVI EnsembleBackbone=ResNet-18, Context Distribution (pxc)=random monochrome2023.12 | 99.19 | — | — | — | |
| OEID dataset=CIFAR-102022.04 | 98.63 | — | 4.36 | — | |
| VOSID dataset=CIFAR-102022.04 | 98.51 | — | 8.65 | — | |
| FSVIBackbone=ResNet-18, Context Distribution (pxc)=CIFAR-1002023.12 | 98.07 | — | — | — | |
| Deep EnsembleBackbone=ResNet-182023.12 | 98.04 | — | — | — | |
| Rot+TransNetwork=ResNet-182020.07 | 97.8 | — | — | — | |
| MahalanobisID dataset=CIFAR-102022.04 | 97.62 | — | 12.89 | — | |
| RotNetwork=ResNet-182020.07 | 97.6 | — | — | — | |
| GOADNetwork=ResNet-182020.07 | 96.3 | — | — | — | |
| RODDID Dataset=CIFAR-1002022.04 | 95.76 | — | 19.89 | — | |
| FSID dataset=CIFAR-102022.04 | 95.31 | — | 24.71 | — | |
| Input ComplexityNetwork=Glow2020.07 | 95 | — | — | — | |
| FSVIBackbone=ResNet-18, Context Distribution (pxc)=random monochrome2023.12 | 94.76 | — | — | — | |
| MAPBackbone=ResNet-182023.12 | 94.65 | — | — | — | |
| FSID Dataset=CIFAR-1002022.04 | 94.33 | — | 22.75 | — | |
| Input ComplexityNetwork=PixelCNN++2020.07 | 92.9 | — | — | — | |
| DUQBackbone=ResNet-182023.12 | 92.7 | — | — | — | |
| MC DROPOUTBackbone=ResNet-182023.12 | 92.44 | — | — | — | |
| MFVIBackbone=ResNet-182023.12 | 92.14 | — | — | — | |
| DIRECTORbase_configuration=KEP-2/72026.02 | 92.14 | — | — | 94.49 | |
| ODINID dataset=CIFAR-102022.04 | 91.96 | — | 33.55 | — | |
| MSPID dataset=CIFAR-102022.04 | 91.89 | — | 48.49 | — | |
| MFVI (tempered)Backbone=ResNet-182023.12 | 91.82 | — | — | — | |
| Clipped HNNTraining Dataset=CIFAR10, Scoring Function=softmax2021.07 | 91.34 | — | 49.89 | 98.13 | |
| Likelihood RatioNetwork=PixelCNN++2020.07 | 91.2 | — | — | — | |
| EnergyID dataset=CIFAR-102022.04 | 90.96 | — | 35.59 | — | |
| DIRECTORbase_configuration=KEP-1/72026.02 | 90.73 | — | — | 93.21 | |
| SWAGBackbone=ResNet-182023.12 | 89.79 | — | — | — | |
| KFLLA2026.02 | 89.47 | — | — | 92.92 | |
| SPGBackbone=ResNet-182023.12 | 88.3 | — | — | — | |
| KEP-2/72026.02 | 88.25 | — | — | 91.56 | |
| VOSID Dataset=CIFAR-1002022.04 | 87.86 | — | 65.56 | — | |
| LPBNaveraging=false2020.07 | 87.7 | — | — | — | |
| VOGNBackbone=ResNet-182023.12 | 87.6 | — | — | — | |
| MCD2026.02 | 87.09 | — | — | 91.46 | |
| ViT2026.02 | 87.09 | — | — | 91.46 | |
| OEID Dataset=CIFAR-1002022.04 | 86.66 | — | 65.91 | — | |
| SVDKL2026.02 | 86.59 | — | — | 90.78 | |
| ENNTraining Dataset=CIFAR10, Scoring Function=softmax2021.07 | 86.58 | — | 71.66 | 97.06 | |
| MahalanobisID Dataset=CIFAR-1002022.04 | 86.01 | — | 57.52 | — | |
| Deep ens. (LPBN)2020.07 | 85.5 | — | — | — | |
| BatchEnsemble2020.07 | 84.8 | — | — | — | |
| Deep ens.2020.07 | 83.9 | — | — | — | |
| DIRECTORbase_configuration=ViT2026.02 | 83.19 | — | — | 88.84 | |
| LPBN2020.07 | 83.1 | — | — | — | |
| SWAG2020.07 | 82.4 | — | — | — | |
| LP HNET2020.07 | 81.5 | — | — | — | |
| Base2020.07 | 81.4 | — | — | — | |
| MC-Dropout2020.07 | 80.6 | — | — | — | |
| DIRECTORbase_configuration=KEP-7/72026.02 | 79.33 | — | — | 85.92 | |
| Dropoutmode=Mean2020.07 | 79.2 | — | — | — | |
| KEP-7/72026.02 | 77.16 | — | — | 84.09 | |
| MSPID Dataset=CIFAR-1002022.04 | 75.46 | — | 82.8 | — | |
| KEP-1/72026.02 | 75.28 | — | — | 81.92 | |
| EnergyID Dataset=CIFAR-1002022.04 | 73.99 | — | 85.52 | — | |
| ODINID Dataset=CIFAR-1002022.04 | 67.26 | — | 84.66 | — | |
| LikelihoodNetwork=EBM2020.07 | 63 | — | — | — | |
| SGPA2026.02 | 61.57 | — | — | 74.59 | |
| LikelihoodNetwork=PixelCNN++2020.07 | 8.3 | — | — | — | |
| LikelihoodNetwork=Glow2020.07 | 8.3 | — | — | — | |
| OursModel Configuration=Baseline2019.12 | — | 76.65 | — | — | |
| OursModel Configuration=Full2019.12 | — | 95.2 | — | — | |
| Outlier Exposure (OE)Model Configuration=Baseline2019.12 | — | 93.7 | — | — | |
| Outlier Exposure (OE)Model Configuration=Full2019.12 | — | 99.9 | — | — |