Generalized OOD Detection on CIFAR-10/Places365/CIFAR-10-C (test)
88.93OOD AccuracyAHA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AHAcategory=Learning w. Pwild2024.10 | 88.93 | 94.3 | — | — | |
| AHA2024.10 | 88.93 | 94.3 | — | — | |
| OursMethod Category=Learning w. Pwild2024.09 | 87.04 | 93.4 | 40.97 | 91.82 | |
| SconeMethod Category=Learning w. Pwild2024.09 | 85.21 | 94.59 | 37.56 | 90.9 | |
| Sconecategory=Learning w. Pwild2024.10 | 85.21 | 94.59 | — | — | |
| SCONE2024.10 | 85.21 | 94.59 | — | — | |
| MixupMethod Category=OOD generalization2024.09 | 79.17 | 93.3 | 58.24 | 75.7 | |
| Mixupcategory=OOD generalization2024.10 | 79.17 | 93.3 | — | — | |
| SharpDROMethod Category=OOD generalization2024.09 | 79.03 | 94.91 | 34.64 | 91.96 | |
| SharpDROcategory=OOD generalization2024.10 | 79.03 | 94.91 | — | — | |
| IRMMethod Category=OOD generalization2024.09 | 77.92 | 90.85 | 53.79 | 88.15 | |
| IRMcategory=OOD generalization2024.10 | 77.92 | 90.85 | — | — | |
| VREXMethod Category=OOD generalization2024.09 | 76.9 | 91.35 | 56.13 | 87.45 | |
| VRExcategory=OOD generalization2024.10 | 76.9 | 91.35 | — | — | |
| EQRMMethod Category=OOD generalization2024.09 | 75.71 | 92.93 | 51 | 88.61 | |
| EQRMcategory=OOD generalization2024.10 | 75.71 | 92.93 | — | — | |
| MSPMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 57.4 | 84.49 | |
| ODINMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 57.4 | 84.49 | |
| EnergyMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 40.14 | 89.89 | |
| MahalanobisMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 68.57 | 84.61 | |
| ViMMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 21.95 | 95.48 | |
| KNNMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 42.67 | 91.07 | |
| ASHMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 44.07 | 88.84 | |
| ERMMethod Category=OOD generalization2024.09 | 75.05 | 94.84 | 40.14 | 89.89 | |
| MSPcategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| ODINcategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| Energycategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| Mahalanobiscategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| ViMcategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| KNNcategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| ASHcategory=OOD detection2024.10 | 75.05 | 94.84 | — | — | |
| ERMcategory=OOD generalization2024.10 | 75.05 | 94.84 | — | — | |
| WoodsMethod Category=Learning w. Pwild2024.09 | 54.58 | 94.88 | 30.48 | 93.28 | |
| Woodscategory=Learning w. Pwild2024.10 | 54.58 | 94.88 | — | — | |
| OEMethod Category=Learning w. Pwild2024.09 | 35.98 | 94.75 | 27.02 | 94.57 | |
| OEcategory=Learning w. Pwild2024.10 | 35.98 | 94.75 | — | — | |
| Energy (w/ outlier)Method Category=Learning w. Pwild2024.09 | 19.86 | 90.55 | 23.89 | 93.6 | |
| Energy (w/ outlier)category=Learning w. Pwild2024.10 | 19.86 | 90.55 | — | — | |
| AHAcategory=Learning w. Pwild2024.10 | — | — | 11.88 | 95.6 | |
| AHA2024.10 | — | — | 11.88 | 95.6 | |
| ASHcategory=OOD detection2024.10 | — | — | 44.07 | 88.84 | |
| Energycategory=OOD detection2024.10 | — | — | 40.14 | 89.89 | |
| Energy (w/ outlier)category=Learning w. Pwild2024.10 | — | — | 23.89 | 93.6 | |
| EQRMcategory=OOD generalization2024.10 | — | — | 51 | 88.61 | |
| ERMcategory=OOD generalization2024.10 | — | — | 40.14 | 89.89 | |
| IRMcategory=OOD generalization2024.10 | — | — | 53.79 | 88.15 | |
| KNNcategory=OOD detection2024.10 | — | — | 42.67 | 91.07 | |
| Mahalanobiscategory=OOD detection2024.10 | — | — | 68.57 | 84.61 | |
| Mixupcategory=OOD generalization2024.10 | — | — | 58.24 | 75.7 | |
| MSPcategory=OOD detection2024.10 | — | — | 57.4 | 84.49 | |
| ODINcategory=OOD detection2024.10 | — | — | 57.4 | 84.49 | |
| OEcategory=Learning w. Pwild2024.10 | — | — | 27.02 | 94.57 | |
| Sconecategory=Learning w. Pwild2024.10 | — | — | 37.56 | 90.9 | |
| SCONE2024.10 | — | — | 37.56 | 90.9 | |
| SharpDROcategory=OOD generalization2024.10 | — | — | 34.64 | 91.96 | |
| ViMcategory=OOD detection2024.10 | — | — | 21.95 | 95.48 | |
| VRExcategory=OOD generalization2024.10 | — | — | 56.13 | 87.45 | |
| Woodscategory=Learning w. Pwild2024.10 | — | — | 30.48 | 93.28 |