One-class Out-of-Distribution Detection on CIFAR-10 (test)
90.4Airplane ScoreOurs + OE
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ours + OEOutlier Exposure=80 Million Tiny Images, Backbone=16-4 WideResNet, Dropout=0.3, Batch size=128, Learning rate schedule=Cosine, Transformations=Rotation + Translation2019.06 | 90.4 | 99.3 | 93.7 | 88.1 | 97.4 | 94.3 | 97.1 | 98.8 | 98.7 | 98.5 | 95.6 | — | |
| CSINetwork=ResNet-182020.07 | 89.9 | 99.1 | 93.1 | 86.4 | 93.9 | 93.2 | 95.1 | 98.7 | 97.9 | 95.5 | 94.3 | — | |
| Supervised (OE)Outlier Exposure=80 Million Tiny Images, Backbone=16-4 WideResNet, Dropout=0.3, Loss function=Focal Loss2019.06 | 87.6 | 93.9 | 78.6 | 79.9 | 81.7 | 85.6 | 93.3 | 87.9 | 92.6 | 92.1 | 87.3 | — | |
| Energybackbone=ResNet-562022.09 | 83.12 | 91.56 | 68.99 | 56.02 | 75.03 | 77.33 | 69.5 | 88.41 | 82.88 | 84.74 | 77.76 | — | |
| ReActbackbone=ResNet-562022.09 | 82.24 | 96.69 | 78.32 | 76.84 | 76.11 | 86.8 | 86.15 | 90.95 | 89.91 | 94.17 | 85.82 | — | |
| Rot+TransNetwork=ResNet-182020.07 | 80.4 | 96.4 | 85.9 | 81.1 | 91.3 | 89.6 | 89.9 | 95.9 | 95 | 92.6 | 89.8 | — | |
| RankFeatbackbone=ResNet-562022.09 | 79.26 | 98.54 | 82.04 | 80.28 | 82.89 | 90.28 | 89.06 | 95.3 | 94.11 | 94.02 | 88.58 | — | |
| RotNetwork=ResNet-182020.07 | 78.3 | 94.3 | 86.2 | 80.8 | 89.4 | 89 | 88.9 | 95.1 | 92.3 | 89.7 | 88.4 | — | |
| OursBackbone=16-4 WideResNet, Dropout=0.3, Batch size=128, Learning rate schedule=Cosine, Transformations=Rotation + Translation2019.06 | 77.5 | 96.9 | 87.3 | 80.9 | 92.7 | 90.2 | 90.9 | 96.5 | 95.2 | 93.3 | 90.1 | — | |
| Rot+TransNetwork=WRN-16-42020.07 | 77.5 | 96.9 | 87.3 | 80.9 | 92.7 | 90.2 | 90.9 | 96.5 | 95.2 | 93.3 | 90.1 | — | |
| GOADNetwork=WRN-10-42020.07 | 77.2 | 96.7 | 83.3 | 77.7 | 87.8 | 87.8 | 90 | 96.1 | 93.8 | 92 | 88.2 | — | |
| Geometric2019.06 | 76.2 | 84.8 | 77.1 | 73.2 | 82.8 | 84.8 | 82 | 88.7 | 89.5 | 83.4 | 82.3 | — | |
| OCGANNetwork=OCGAN2020.07 | 75.7 | 53.1 | 64 | 62 | 72.3 | 62 | 72.3 | 57.5 | 82 | 55.4 | 65.7 | — | |
| GOADNetwork=ResNet-182020.07 | 75.5 | 94.1 | 81.8 | 72 | 83.7 | 84.4 | 82.9 | 93.9 | 92.9 | 89.5 | 85.1 | — | |
| GeomNetwork=WRN-16-82020.07 | 74.7 | 95.7 | 78.1 | 72.4 | 87.8 | 87.8 | 83.4 | 95.5 | 93.3 | 91.3 | 86 | — | |
| DIM2019.06 | 72.6 | 52.3 | 60.5 | 53.9 | 66.7 | 51 | 62.7 | 59.2 | 52.8 | 47.6 | 57.9 | — | |
| RotNetBackbone=16-4 WideResNet, Dropout=0.3, Batch size=128, Learning rate schedule=Cosine2019.06 | 71.9 | 94.5 | 78.4 | 70 | 77.2 | 86.6 | 81.6 | 93.7 | 90.7 | 88.8 | 83.3 | — | |
| RotNetwork=WRN-16-42020.07 | 71.9 | 94.5 | 78.4 | 70 | 77.2 | 86.6 | 81.6 | 93.7 | 90.7 | 88.8 | 83.3 | — | |
| IIC2019.06 | 68.4 | 89.4 | 49.8 | 65.3 | 60.5 | 59.1 | 49.3 | 74.8 | 81.8 | 75.7 | 67.4 | — | |
| AnoGANNetwork=DCGAN2020.07 | 67.1 | 54.7 | 52.9 | 54.5 | 65.1 | 60.3 | 58.5 | 62.5 | 75.8 | 66.5 | 61.8 | — | |
| OC-SVM2019.06 | 65.6 | 40.9 | 65.3 | 50.1 | 75.2 | 51.2 | 71.8 | 51.2 | 67.9 | 48.5 | 58.8 | — | |
| OC-SVM2020.07 | 65.6 | 40.9 | 65.3 | 50.1 | 75.2 | 51.2 | 71.8 | 51.2 | 67.9 | 48.5 | 58.8 | — | |
| DeepSVDD2019.06 | 61.7 | 65.9 | 50.8 | 59.1 | 60.9 | 65.7 | 67.7 | 67.3 | 75.9 | 73.1 | 64.8 | — | |
| DeepSVDDNetwork=LeNet2020.07 | 61.7 | 65.9 | 50.8 | 59.1 | 60.9 | 65.7 | 67.7 | 67.3 | 75.9 | 73.1 | 64.8 | — | |
| MSPbackbone=ResNet-562022.09 | 59.75 | 52.48 | 62.96 | 48.73 | 59.15 | 52.39 | 67.33 | 59.34 | 54.55 | 51.97 | 56.87 | — | |
| AND2021.03 | — | — | — | — | — | — | — | — | — | — | — | 61.72 | |
| AnoGAN2021.03 | — | — | — | — | — | — | — | — | — | — | — | 61.79 | |
| DAE2021.03 | — | — | — | — | — | — | — | — | — | — | — | 53.58 | |
| DSVDD2021.03 | — | — | — | — | — | — | — | — | — | — | — | 64.81 | |
| GAN2021.03 | — | — | — | — | — | — | — | — | — | — | — | 59.16 | |
| OCGAN2021.03 | — | — | — | — | — | — | — | — | — | — | — | 65.66 | |
| OCSVM2021.03 | — | — | — | — | — | — | — | — | — | — | — | 58.56 | |
| OLEDScoring function=S_rec2021.03 | — | — | — | — | — | — | — | — | — | — | — | 66.22 | |
| OLEDScoring function=S_mask2021.03 | — | — | — | — | — | — | — | — | — | — | — | 67.11 | |
| OLEDScoring function=S_avg2021.03 | — | — | — | — | — | — | — | — | — | — | — | 66.83 | |
| OLEDScoring function=S_cont2021.03 | — | — | — | — | — | — | — | — | — | — | — | 66.73 | |
| PixCNN2021.03 | — | — | — | — | — | — | — | — | — | — | — | 55.06 | |
| VAE2021.03 | — | — | — | — | — | — | — | — | — | — | — | 58.33 |