Out-of-distribution Detection on SVHN vs CIFAR-10 (test)
99.98AUROClambda (Similarity-only)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| lambda (Similarity-only)2026.02 | 99.98 | — | — | — | — | — | |
| SPEMFlow Model=ResFlow, Feature Extractor=ResNet-152, Hyperparameter alpha=0.42026.02 | 99.97 | — | — | — | — | — | |
| SPEM-noiseFlow Model=ResFlow, Feature Extractor=ResNet-152, Hyperparameter alpha=0.12026.02 | 99.97 | — | — | — | — | — | |
| Typicality (sqrt(d))Flow Model=ResFlow2026.02 | 99.69 | — | — | — | — | — | |
| LikelihoodFlow Model=ResFlow2026.02 | 99.67 | — | — | — | — | — | |
| Typicality (Entropy)Flow Model=ResFlow2026.02 | 99.38 | — | — | — | — | — | |
| Mahalanobis distance-based scoreBackbone=ResNet, Validation Setup=OOD samples2018.07 | 99.3 | 98.4 | 96.9 | — | — | — | |
| MahalanobisBackbone=ResNet2018.07 | 99.3 | 98.4 | 96.9 | 99.7 | 97 | — | |
| MahalanobisBackbone=ResNet2019.12 | 99.3 | 98.4 | 96.9 | — | — | — | |
| MahalanobisModel Architecture=ResNet2019.12 | 99.3 | 98.4 | 96.9 | — | — | — | |
| GMMFlow Model=ResFlow2026.02 | 99.3 | — | — | — | — | — | |
| ComplexityFlow Model=ResFlow2026.02 | 99.12 | — | — | — | — | — | |
| Mahalanobis distance-based scoreBackbone=DenseNet, Validation Setup=OOD samples2018.07 | 98.9 | 96.8 | 95.9 | — | — | — | |
| MahalanobisBackbone=DenseNet2018.07 | 98.9 | 96.8 | 95.9 | 99.6 | 95.8 | — | |
| MahalanobisBackbone=DenseNet2019.12 | 98.9 | 96.8 | 95.9 | — | — | — | |
| MahalanobisModel Architecture=DenseNet2019.12 | 98.9 | 96.8 | 95.9 | — | — | — | |
| Mahalanobis distance-based scoreBackbone=DenseNet, Validation Setup=adversarial samples2018.07 | 98.8 | 97.5 | 96.3 | — | — | — | |
| LIDFlow Model=ResFlow2026.02 | 98.7 | — | — | — | — | — | |
| Mahalanobis distance-based scoreBackbone=ResNet, Validation Setup=adversarial samples2018.07 | 97.6 | 94.1 | 94.6 | — | — | — | |
| OursBackbone=ResNet2019.12 | 97.3 | 85.8 | 92 | — | — | — | |
| OursModel Architecture=ResNet2019.12 | 97.3 | 85.8 | 92 | — | — | — | |
| Likelihood RatioFlow Model=ResFlow2026.02 | 96.4 | — | — | — | — | — | |
| OursBackbone=DenseNet2019.12 | 95.5 | 80.4 | 89.1 | — | — | — | |
| OursModel Architecture=DenseNet2019.12 | 95.5 | 80.4 | 89.1 | — | — | — | |
| BaselineBackbone=ResNet, Validation Setup=OOD samples2018.07 | 92.9 | 78.3 | 90 | — | — | — | |
| BaselineBackbone=ResNet, Validation Setup=adversarial samples2018.07 | 92.9 | 78.3 | 90 | — | — | — | |
| BaselineBackbone=ResNet2018.07 | 92.9 | 78.3 | 90 | 95.1 | 85.7 | — | |
| BaselineBackbone=ResNet2019.12 | 92.9 | 78.3 | 90 | — | — | — | |
| BaselineModel Architecture=ResNet2019.12 | 92.9 | 78.3 | 90 | — | — | — | |
| ODINBackbone=ResNet, Validation Setup=OOD samples2018.07 | 92.1 | 79.8 | 89.4 | — | — | — | |
| ODINBackbone=ResNet, Validation Setup=adversarial samples2018.07 | 92.1 | 79.8 | 89.4 | — | — | — | |
| ODINBackbone=ResNet2018.07 | 92.1 | 79.8 | 89.4 | 94 | 86.8 | — | |
| ODINBackbone=ResNet2019.12 | 92.1 | 79.8 | 89.4 | — | — | — | |
| ODINModel Architecture=ResNet2019.12 | 92.1 | 79.8 | 89.4 | — | — | — | |
| BaselineBackbone=DenseNet, Validation Setup=OOD samples2018.07 | 91.9 | 69.3 | 86.6 | — | — | — | |
| BaselineBackbone=DenseNet, Validation Setup=adversarial samples2018.07 | 91.9 | 69.3 | 86.6 | — | — | — | |
| ODINBackbone=DenseNet, Validation Setup=adversarial samples2018.07 | 91.9 | 69.3 | 86.6 | — | — | — | |
| BaselineBackbone=DenseNet2018.07 | 91.9 | 69.3 | 86.6 | 95.7 | 82.8 | — | |
| BaselineBackbone=DenseNet2019.12 | 91.9 | 69.3 | 86.6 | — | — | — | |
| BaselineModel Architecture=DenseNet2019.12 | 91.9 | 69.3 | 86.6 | — | — | — | |
| ODINBackbone=DenseNet, Validation Setup=OOD samples2018.07 | 91.4 | 71.7 | 85.8 | — | — | — | |
| ODINBackbone=DenseNet2018.07 | 91.4 | 71.7 | 85.8 | 95.2 | 84.5 | — | |
| ODINBackbone=DenseNet2019.12 | 91.4 | 71.7 | 85.8 | — | — | — | |
| ODINModel Architecture=DenseNet2019.12 | 91.4 | 71.7 | 85.8 | — | — | — | |
| REGrad*layer-selective=true, perturbation=true2024.04 | 91.11 | — | — | — | — | 89.63 | |
| ExGrad V Term2024.04 | 89.72 | — | — | — | — | 87.9 | |
| Entropy2024.04 | 89.64 | — | — | — | — | 87.76 | |
| Perturb θ2024.04 | 89.01 | — | — | — | — | 86.04 | |
| Exgrad2024.04 | 88.57 | — | — | — | — | 85.55 | |
| Inserted Dropout2024.04 | 88.47 | — | — | — | — | 83.97 | |
| LA2024.04 | 80.73 | — | — | — | — | 87.46 | |
| Perturb x2024.04 | 72.76 | — | — | — | — | 60.6 | |
| MC-AA2024.04 | 71.53 | — | — | — | — | 60.98 | |
| UNGrad2024.04 | 68.28 | — | — | — | — | 69.21 | |
| NEGrad2024.04 | 30.26 | — | — | — | — | 39.13 | |
| GradNorm2024.04 | 24.49 | — | — | — | — | 36.56 |