Novelty Detection on SVHN [0:4] (ID) vs [5:9] (OOD) (test)
0.96AUROCnnPU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| nnPUEvaluation Setting=SSND, Oracle=true2020.12 | 0.96 | 73 | |
| ERDEvaluation Setting=SSND, Oracle=false2020.12 | 0.95 | 73 | |
| Vanilla EnsemblesEvaluation Setting=Other settings, Oracle=false2020.12 | 0.92 | 69 | |
| MahalanobisEvaluation Setting=SSND, Oracle=true2020.12 | 0.92 | 71 | |
| MCDEvaluation Setting=SSND, Oracle=true2020.12 | 0.91 | 51 | |
| Mahalanobis-UEvaluation Setting=SSND, Oracle=false2020.12 | 0.91 | 63 | |
| DPNEvaluation Setting=Other settings, Oracle=false2020.12 | 0.87 | 19 | |
| OEEvaluation Setting=Other settings, Oracle=false2020.12 | 0.85 | 52 | |
| GramEvaluation Setting=Other settings, Oracle=false2020.12 | 0.81 | 31 | |
| Binary ClassificationEvaluation Setting=SSND, Oracle=false2020.12 | 0.81 | 40 |