Misclassification Detection on CIFAR-10 (test)
100AUPR SuccSoftmax Baseline
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Softmax BaselineArchitecture=40-4 wide residual network, Nonlinearity=GELU, Optimizer=SGD with restarts2016.10 | 100 | 93 | 50 | 95 | 43 | 5 | 80 | — | — | |
| Deep EnsemblesM (Ensemble size)=52026.05 | 99.32 | — | — | — | — | — | — | — | — | |
| MoDEX2026.05 | 99.18 | — | — | — | — | — | — | — | — | |
| MoDEXM (Ensemble size)=12026.05 | 99.18 | — | — | — | — | — | — | — | — | |
| F-EDL2026.05 | 99.1 | — | — | — | — | — | — | — | — | |
| DAEDL2026.05 | 99.08 | — | — | — | — | — | — | — | — | |
| R-EDL2026.05 | 98.98 | — | — | — | — | — | — | — | — | |
| Dropout2026.05 | 98.86 | — | — | — | — | — | — | — | — | |
| RED2026.05 | 98.82 | — | — | — | — | — | — | — | — | |
| Re-EDL2026.05 | 98.81 | — | — | — | — | — | — | — | — | |
| EDL2026.05 | 98.74 | — | — | — | — | — | — | — | — | |
| I-EDL2026.05 | 98.72 | — | — | — | — | — | — | — | — | |
| DUQ2026.05 | 97.89 | — | — | — | — | — | — | — | — | |
| NatPN2026.05 | 97.53 | — | — | — | — | — | — | — | — | |
| PostNet2026.05 | 97.46 | — | — | — | — | — | — | — | — | |
| D_alphaProtocol=TBB (Totally Black-Box), Classifier Accuracy=95%2021.06 | — | 94 | — | — | — | — | — | 17.9 | — | |
| D_alphaProtocol=PBB (Partially Black-Box), Classifier Accuracy=95%2021.06 | — | 95.2 | — | — | — | — | — | 13.9 | — | |
| D_betaProtocol=TBB (Totally Black-Box), Classifier Accuracy=95%2021.06 | — | 68.5 | — | — | — | — | — | 18.6 | — | |
| D_betaProtocol=PBB (Partially Black-Box), Classifier Accuracy=95%2021.06 | — | 94.8 | — | — | — | — | — | 13.4 | — | |
| DAEDL2025.10 | — | — | — | — | — | — | — | — | 99.08 | |
| DAEDLCalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 99.08 | |
| Dropout2025.10 | — | — | — | — | — | — | — | — | 97.15 | |
| EDL2025.10 | — | — | — | — | — | — | — | — | 97.86 | |
| EDLCalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 98.74 | |
| ENERGYProtocol=PBB (Partially Black-Box), Classifier Accuracy=95%2021.06 | — | 91.1 | — | — | — | — | — | 34.7 | — | |
| F-EDL2025.10 | — | — | — | — | — | — | — | — | 99.1 | |
| GEM-CORECalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 99.22 | |
| GEM-FICalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 99.94 | |
| GEM-MIXCalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 99.43 | |
| I-EDL2025.10 | — | — | — | — | — | — | — | — | 98.72 | |
| I-EDLCalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 98.71 | |
| MHLNBProtocol=TBB (Totally Black-Box), Classifier Accuracy=95%2021.06 | — | 92.2 | — | — | — | — | — | 30.8 | — | |
| MHLNBProtocol=PBB (Partially Black-Box), Classifier Accuracy=95%2021.06 | — | 84.4 | — | — | — | — | — | 44.6 | — | |
| ODINProtocol=TBB (Totally Black-Box), Classifier Accuracy=95%2021.06 | — | 93.8 | — | — | — | — | — | 18.2 | — | |
| ODINProtocol=PBB (Partially Black-Box), Classifier Accuracy=95%2021.06 | — | 94.2 | — | — | — | — | — | 18.4 | — | |
| R-EDL2025.10 | — | — | — | — | — | — | — | — | 98.98 | |
| R-EDLCalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 98.98 | |
| Re-EDLCalibration Protocol=pre-calibration2026.05 | — | — | — | — | — | — | — | — | 98.81 | |
| SRProtocol=TBB (Totally Black-Box), Classifier Accuracy=95%2021.06 | — | 93.8 | — | — | — | — | — | 18.2 | — | |
| TSCalibration Protocol=post-hoc2026.05 | — | — | — | — | — | — | — | — | 98.89 |