OOD Detection on CIFAR-10 (test) using AUROC, FPR95, AUPR, and ID-ACC
100AUROCDRUE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DRUEBackbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V22026.01 | 100 | — | 100 | — | |
| DiverseMixBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 99.42 | 1.92 | 99.51 | 94.16 | |
| DiverseMixBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 99.42 | 1.92 | 99.51 | 94.16 | |
| POEMBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 99.4 | 2.54 | 99.5 | 93.49 | |
| POEMBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 99.4 | 2.54 | 99.5 | 93.49 | |
| NTOMBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 99.09 | 4 | 98.61 | 94.26 | |
| NTOMBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 99.09 | 4 | 98.61 | 94.26 | |
| SOFLBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 98.98 | 5.41 | 99.1 | 93.68 | |
| SOFLBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 98.98 | 5.41 | 99.1 | 93.68 | |
| EnergyBackbone=DenseNet, uses_auxiliary_outliers=true, mode=w. Daux2024.11 | 98.93 | 4.62 | 99.12 | 92.92 | |
| EnergyBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 98.93 | 4.62 | 99.12 | 92.92 | |
| SSD+Backbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 98.48 | 7.22 | 98.59 | — | |
| SSD+Backbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 98.48 | 7.22 | 98.59 | — | |
| CCUBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 98.41 | 8.78 | 98.69 | 93.97 | |
| CCUBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 98.41 | 8.78 | 98.69 | 93.97 | |
| OEBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 98.34 | 9.66 | 98.55 | 94.12 | |
| OEBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 98.34 | 9.66 | 98.55 | 94.12 | |
| DivOEBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 97.76 | 11.41 | 98.18 | 93.74 | |
| DivOEBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 97.76 | 11.41 | 98.18 | 94.07 | |
| MixOEBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 97.16 | 14.54 | 97.41 | 94.48 | |
| MixOEBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 97.16 | 14.54 | 97.41 | 94.48 | |
| EnergyBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 94.39 | 28.53 | 95.56 | 94.39 | |
| EnergyBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 94.39 | 28.53 | 95.56 | 94.39 | |
| ODINBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 94.25 | 26.55 | 95.34 | 94.39 | |
| ODINBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 94.25 | 26.55 | 95.34 | 94.39 | |
| MC DropoutBackbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V22026.01 | 94 | — | 100 | — | |
| MSPBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 90.63 | 58.98 | 93.18 | 94.39 | |
| MSPBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 90.63 | 58.98 | 93.18 | 94.39 | |
| PostNet Alea.Backbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V2, Type=Aleatoric2026.01 | 90 | — | 93 | — | |
| MahalanobisBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 89.96 | 29.47 | 89.7 | 94.39 | |
| MahalanobisBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 89.96 | 29.47 | 89.7 | 94.39 | |
| BalCAL2025.04 | 89.89 | 64.15 | — | — | |
| GEM-FICalibration Protocol=pre-calibration2026.05 | 89.3 | — | — | — | |
| GEM-CORECalibration Protocol=pre-calibration2026.05 | 88.72 | — | — | — | |
| Vanilla2025.04 | 88.56 | 70.98 | — | — | |
| TST2025.04 | 88.47 | 67.28 | — | — | |
| GEM-MIXCalibration Protocol=pre-calibration2026.05 | 88.23 | — | — | — | |
| DAEDLCalibration Protocol=pre-calibration2026.05 | 88.19 | — | — | — | |
| EntropyBackbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V22026.01 | 88 | — | 98 | — | |
| PLP2025.04 | 86.8 | 73.62 | — | — | |
| Re-EDLCalibration Protocol=pre-calibration2026.05 | 85.46 | — | — | — | |
| R-EDLCalibration Protocol=pre-calibration2026.05 | 83.73 | — | — | — | |
| VTST2025.04 | 83.47 | 72.4 | — | — | |
| PostNet Epis.Backbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V2, Type=Epistemic2026.01 | 83 | — | 89 | — | |
| PRO-fDBDepsilon=2/255, Attack Type=PGD-Min2026.05 | 82.65 | 54.07 | — | — | |
| EDLCalibration Protocol=pre-calibration2026.05 | 82.32 | — | — | — | |
| TSCalibration Protocol=post-hoc2026.05 | 82.07 | — | — | — | |
| I-EDLCalibration Protocol=pre-calibration2026.05 | 82.01 | — | — | — | |
| PRO-GENepsilon=2/255, Attack Type=PGD-Min2026.05 | 81.8 | 58.6 | — | — | |
| ROSS-fDBDepsilon=2/255, Attack Type=PGD-Max2026.05 | 81.02 | 51.05 | — | — | |
| ROSS-fDBDepsilon=2/255, Attack Type=PGD-Min2026.05 | 80.98 | 52.46 | — | — | |
| ROSS-EBOepsilon=2/255, Attack Type=PGD-Max2026.05 | 80.57 | 59.94 | — | — | |
| ROSS-GENepsilon=2/255, Attack Type=PGD-Max2026.05 | 78.78 | 58.8 | — | — | |
| ROSS-GENepsilon=2/255, Attack Type=PGD-Min2026.05 | 78.75 | 58.42 | — | — | |
| ROSS-EBOepsilon=2/255, Attack Type=PGD-Min2026.05 | 78.01 | 63.18 | — | — | |
| ROSS-MSPepsilon=2/255, Attack Type=PGD-Min2026.05 | 77.65 | 56.09 | — | — | |
| ROSS-MSPepsilon=2/255, Attack Type=PGD-Max2026.05 | 77.65 | 55.87 | — | — | |
| fDBDepsilon=2/255, Attack Type=PGD-Min2026.05 | 76.23 | 59.92 | — | — | |
| PRO-fDBDepsilon=2/255, Attack Type=PGD-Max2026.05 | 74.88 | 61.83 | — | — | |
| ROSS-fDBDepsilon=4/255, Attack Type=PGD-Max2026.05 | 74.58 | 60.51 | — | — | |
| ROSS-fDBDepsilon=4/255, Attack Type=PGD-Min2026.05 | 74.34 | 64.47 | — | — | |
| PRO-GENepsilon=2/255, Attack Type=PGD-Max2026.05 | 73.01 | 79.16 | — | — | |
| PRO-fDBDepsilon=4/255, Attack Type=PGD-Min2026.05 | 72.38 | 73.79 | — | — | |
| EBOepsilon=2/255, Attack Type=PGD-Min2026.05 | 72.34 | 83.21 | — | — | |
| GENepsilon=2/255, Attack Type=PGD-Min2026.05 | 72.01 | 77.84 | — | — | |
| ROSS-GENepsilon=4/255, Attack Type=PGD-Min2026.05 | 71.95 | 70.83 | — | — | |
| PRO-GENepsilon=4/255, Attack Type=PGD-Min2026.05 | 71.85 | 78.11 | — | — | |
| ROSS-GENepsilon=4/255, Attack Type=PGD-Max2026.05 | 71.62 | 70.35 | — | — | |
| ROSS-EBOepsilon=4/255, Attack Type=PGD-Min2026.05 | 71.48 | 75.06 | — | — | |
| ROSS-MSPepsilon=4/255, Attack Type=PGD-Max2026.05 | 69.98 | 69.03 | — | — | |
| ROSS-EBOepsilon=4/255, Attack Type=PGD-Max2026.05 | 69.96 | 79.87 | — | — | |
| ROSS-MSPepsilon=4/255, Attack Type=PGD-Min2026.05 | 69.71 | 68.32 | — | — | |
| fDBDepsilon=2/255, Attack Type=PGD-Max2026.05 | 69.51 | 78.99 | — | — | |
| ODINepsilon=2/255, Attack Type=PGD-Min2026.05 | 69.08 | 89.03 | — | — | |
| MSPepsilon=2/255, Attack Type=PGD-Min2026.05 | 68.44 | 74.24 | — | — | |
| DECBackbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V22026.01 | 66 | — | 96 | — | |
| BNNBackbone=ResNet-18, In-distribution Dataset=Glaucoma-Light V22026.01 | 64 | — | 96 | — | |
| ROSS-fDBDepsilon=8/255, Attack Type=PGD-Min2026.05 | 59.1 | 84.39 | — | — | |
| fDBDepsilon=4/255, Attack Type=PGD-Min2026.05 | 58.89 | 82.87 | — | — | |
| ROSS-fDBDepsilon=8/255, Attack Type=PGD-Max2026.05 | 58.81 | 81.99 | — | — | |
| MSPepsilon=2/255, Attack Type=PGD-Max2026.05 | 57.81 | 92.59 | — | — | |
| ROSS-EBOepsilon=8/255, Attack Type=PGD-Min2026.05 | 56.99 | 90.74 | — | — | |
| GENepsilon=2/255, Attack Type=PGD-Max2026.05 | 56.93 | 93.09 | — | — | |
| ROSS-GENepsilon=8/255, Attack Type=PGD-Min2026.05 | 56.85 | 88.3 | — | — | |
| PRO-GENepsilon=8/255, Attack Type=PGD-Min2026.05 | 55.99 | 94.08 | — | — | |
| EBOepsilon=2/255, Attack Type=PGD-Max2026.05 | 55.2 | 93.8 | — | — | |
| ROSS-GENepsilon=8/255, Attack Type=PGD-Max2026.05 | 54.32 | 88.08 | — | — | |
| PRO-fDBDepsilon=8/255, Attack Type=PGD-Min2026.05 | 54.11 | 92.13 | — | — | |
| ROSS-MSPepsilon=8/255, Attack Type=PGD-Max2026.05 | 52.65 | 89.83 | — | — | |
| ODINepsilon=2/255, Attack Type=PGD-Max2026.05 | 52.57 | 93.22 | — | — | |
| GENepsilon=4/255, Attack Type=PGD-Min2026.05 | 52.36 | 93.97 | — | — | |
| ROSS-MSPepsilon=8/255, Attack Type=PGD-Min2026.05 | 52.29 | 85.99 | — | — | |
| EBOepsilon=4/255, Attack Type=PGD-Min2026.05 | 51.22 | 95.94 | — | — | |
| ROSS-EBOepsilon=8/255, Attack Type=PGD-Max2026.05 | 51.17 | 93.67 | — | — | |
| ODINepsilon=4/255, Attack Type=PGD-Min2026.05 | 50.43 | 97.56 | — | — | |
| MSPepsilon=4/255, Attack Type=PGD-Min2026.05 | 48.73 | 92.4 | — | — | |
| PRO-fDBDepsilon=4/255, Attack Type=PGD-Max2026.05 | 47.59 | 93.38 | — | — | |
| fDBDepsilon=4/255, Attack Type=PGD-Max2026.05 | 43.52 | 96 | — | — | |
| PRO-GENepsilon=4/255, Attack Type=PGD-Max2026.05 | 41.28 | 96.73 | — | — | |
| fDBDepsilon=8/255, Attack Type=PGD-Min2026.05 | 35.54 | 97.25 | — | — |