Out-of-distribution Detection on ImageNet-30 (test)
91.6Mean AUROCCSI
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CSINetwork=ResNet-182020.07 | 91.6 | — | — | — | — | — | — | — | — | — | |
| Rot+Trans+Attn+ResizeNetwork=ResNet-182020.07 | 85.7 | — | — | — | — | — | — | — | — | — | |
| Rot+Trans+AttnNetwork=ResNet-182020.07 | 84.8 | — | — | — | — | — | — | — | — | — | |
| Rot+AttnNetwork=ResNet-182020.07 | 81.6 | — | — | — | — | — | — | — | — | — | |
| Rot+TransNetwork=ResNet-182020.07 | 77.9 | — | — | — | — | — | — | — | — | — | |
| RotNetwork=ResNet-182020.07 | 65.3 | — | — | — | — | — | — | — | — | — | |
| MOOD2023.02 | 0.989 | — | 0.994 | 0.991 | 1 | 0.966 | 0.989 | 0.995 | 0.989 | — | |
| Shifting transformation learningTraining Objective=Lssl + Lsup2021.06 | 0.9669 | 0.9644 | 0.9707 | 0.9637 | 0.9718 | 0.9649 | — | — | 0.9656 | — | |
| CSI (ens)ensemble=true2021.06 | 0.9567 | 0.9415 | 0.9764 | 0.9849 | 0.9618 | 0.8904 | — | — | 0.9854 | — | |
| CSIstatus=SOTA2023.02 | 0.948 | — | 0.983 | 0.974 | 0.962 | 0.87 | 0.94 | 0.932 | 0.974 | — | |
| CSIensemble=false2021.06 | 0.9477 | 0.9332 | 0.9643 | 0.9735 | 0.9543 | 0.8848 | — | — | 0.9763 | — | |
| SSD+2021.06 | 0.9414 | 0.9657 | 0.9523 | 0.9624 | 0.9647 | 0.8548 | — | — | 0.9486 | — | |
| SupSimCLRTraining Type=Contrastive Learning2021.06 | 0.9281 | 0.8919 | 0.9516 | 0.9638 | 0.9381 | 0.8361 | — | — | 0.987 | — | |
| Shifting transformation learningTraining Objective=Lssl2021.06 | 0.9208 | 0.9334 | 0.9363 | 0.9482 | 0.9419 | 0.8251 | — | — | 0.9399 | — | |
| CSINetwork=ResNet-182020.07 | 0.916 | — | — | — | — | — | — | — | — | — | |
| GeometricTraining Type=Self-supervised2021.06 | 0.9142 | 0.9058 | 0.9325 | 0.9528 | 0.9213 | 0.8509 | — | — | 0.9216 | — | |
| Contrastive loss2023.02 | 0.907 | — | 0.956 | 0.942 | 0.922 | 0.812 | 0.897 | 0.902 | 0.921 | — | |
| CSINetwork=ResNet-182020.07 | 0.905 | — | — | — | — | — | — | — | — | — | |
| Baseline OOD2023.02 | 0.903 | — | 0.967 | 0.95 | 0.897 | 0.798 | 0.905 | 0.906 | 0.901 | — | |
| BaselineTraining Type=Supervised2021.06 | 0.8701 | 0.8526 | 0.903 | 0.9288 | 0.877 | 0.7893 | — | — | 0.8698 | — | |
| Rot+Trans+Attn+ResizeNetwork=ResNet-182020.07 | 0.857 | — | — | — | — | — | — | — | — | — | |
| CSINetwork=ResNet-182020.07 | 0.852 | — | — | — | — | — | — | — | — | — | |
| Rot+Trans+AttnNetwork=ResNet-182020.07 | 0.848 | — | — | — | — | — | — | — | — | — | |
| Rot+AttnNetwork=ResNet-182020.07 | 0.816 | — | — | — | — | — | — | — | — | — | |
| Rot+TransNetwork=ResNet-182020.07 | 0.779 | — | — | — | — | — | — | — | — | — | |
| RotNetwork=ResNet-182020.07 | 0.765 | — | — | — | — | — | — | — | — | — | |
| Rot+TransNetwork=ResNet-182020.07 | 0.745 | — | — | — | — | — | — | — | — | — | |
| GOADNetwork=ResNet-182020.07 | 0.715 | — | — | — | — | — | — | — | — | — | |
| RotNetwork=ResNet-182020.07 | 0.7 | — | — | — | — | — | — | — | — | — | |
| Rot+TransNetwork=ResNet-182020.07 | 0.7 | — | — | — | — | — | — | — | — | — | |
| GOADNetwork=ResNet-182020.07 | 0.655 | — | — | — | — | — | — | — | — | — | |
| RotNetwork=ResNet-182020.07 | 0.653 | — | — | — | — | — | — | — | — | — | |
| Cross EntropyTrain method=Cross Entropy2020.07 | — | 0.88 | 0.967 | 0.95 | 0.897 | 0.798 | 0.905 | 0.906 | 0.901 | — | |
| CSITrain method=CSI, Ensemble=false2020.07 | — | 0.934 | 0.977 | 0.969 | 0.96 | 0.87 | 0.925 | 0.919 | 0.937 | — | |
| CSI-ensTrain method=CSI-ens, Ensemble=true, inference_speed=4 times slower2020.07 | — | 0.946 | 0.983 | 0.974 | 0.962 | 0.889 | 0.94 | 0.932 | 0.974 | — | |
| CSI-ensTraining Mode=Unlabeled multi-class2021.06 | — | — | — | — | — | — | — | — | — | 92.13 | |
| GeometricTraining Mode=Unlabeled multi-class2021.06 | — | — | — | — | — | — | — | — | — | 85.11 | |
| Shifting Transformation Learning (Lssl)Training Mode=Unlabeled multi-class2021.06 | — | — | — | — | — | — | — | — | — | 96.57 | |
| SimCLRTraining Mode=Unlabeled multi-class2021.06 | — | — | — | — | — | — | — | — | — | 65.27 | |
| SSDTraining Mode=Unlabeled multi-class2021.06 | — | — | — | — | — | — | — | — | — | 87.42 | |
| SupCLRTrain method=SupCLR2020.07 | — | 0.863 | 0.956 | 0.942 | 0.922 | 0.812 | 0.897 | 0.902 | 0.921 | — |