Multi-Source OOD Detection on CIFAR-10, SVHN, and CIFAR-10-C
89.01OOD AccuracyAHA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AHA2024.10 | 89.01 | 94.67 | — | — | |
| AHAMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 89.01 | 94.67 | 0.08 | 99.99 | |
| SCONE2024.10 | 84.69 | 94.65 | — | — | |
| SCONEMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 84.69 | 94.65 | 0.08 | 99.99 | |
| MixupMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 79.17 | 93.3 | 97.33 | 18.78 | |
| SharpDROMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 79.03 | 94.91 | 21.24 | 96.14 | |
| IRMMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 77.92 | 90.85 | 63.65 | 90.7 | |
| VREXMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 76.9 | 91.35 | 55.92 | 91.22 | |
| EQRMMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 75.71 | 92.93 | 51.86 | 90.92 | |
| MSPMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 48.49 | 88.5 | |
| ODINMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 33.35 | 94.84 | |
| EnergyMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 35.59 | 90.96 | |
| MahalanobisMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 12.89 | 97.33 | |
| ViMMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 21.95 | 93.7 | |
| KNNMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 28.92 | 92.73 | |
| ASHMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 40.76 | 90.16 | |
| ERMMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 35.59 | 90.96 | |
| WOODSMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 52.76 | 94.86 | 2.11 | 99.52 | |
| OEMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 37.61 | 94.68 | 0.84 | 99.8 | |
| Energy (w. outlier)Method Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 20.74 | 90.22 | 0.86 | 99.81 | |
| Graph-Spectral OODMethod Category=Learning w. Pwild2024.09 | 0.8662 | 0.931 | 0.0013 | 0.9998 | |
| SconeMethod Category=Learning w. Pwild2024.09 | 0.8469 | 0.9465 | 0.1086 | 0.9784 | |
| MixupMethod Category=OOD generalization2024.09 | 0.7917 | 0.933 | 0.9733 | 0.1878 | |
| SharpDROMethod Category=OOD generalization2024.09 | 0.7903 | 0.9491 | 0.2124 | 0.9614 | |
| IRMMethod Category=OOD generalization2024.09 | 0.7792 | 0.9085 | 0.6365 | 0.907 | |
| VREXMethod Category=OOD generalization2024.09 | 0.769 | 0.9135 | 0.5592 | 0.9122 | |
| EQRMMethod Category=OOD generalization2024.09 | 0.7571 | 0.9293 | 0.5186 | 0.9092 | |
| MSPMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.4849 | 0.9189 | |
| ODINMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.3335 | 0.9196 | |
| EnergyMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.3559 | 0.9096 | |
| MahalanobisMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.1289 | 0.9762 | |
| ViMMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.2195 | 0.9548 | |
| KNNMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.2892 | 0.9571 | |
| ASHMethod Category=OOD detection2024.09 | 0.7505 | 0.9484 | 0.4076 | 0.9016 | |
| ERMMethod Category=OOD generalization2024.09 | 0.7505 | 0.9484 | 0.3559 | 0.9096 | |
| WoodsMethod Category=Learning w. Pwild2024.09 | 0.5276 | 0.9486 | 0.0211 | 0.9952 | |
| OEMethod Category=Learning w. Pwild2024.09 | 0.3761 | 0.9468 | 0.0084 | 0.998 | |
| Energy (w. outlier)Method Category=Learning w. Pwild2024.09 | 0.2074 | 0.9022 | 0.0086 | 0.9981 |