Out-of-Distribution Detection and Generalization on CIFAR-10 (ID) vs Textures (OOD) and CIFAR-10-C (OOD)
90.51OOD AccuracyAHA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AHA2024.10 | 90.51 | 94.54 | — | — | |
| AHAMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 90.51 | 94.54 | 5.63 | 97.95 | |
| SconeMethod Category=Learning w. Pwild2024.09 | 85.56 | 93.97 | 37.15 | 90.91 | |
| SCONE2024.10 | 85.56 | 93.97 | — | — | |
| SCONEMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 85.56 | 93.97 | 37.15 | 90.91 | |
| WoodsMethod Category=Learning w. Pwild2024.09 | 83.14 | 94.49 | 39.1 | 90.45 | |
| WOODSMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 83.14 | 94.49 | 39.1 | 90.45 | |
| Graph-Spectral OODMethod Category=Learning w. Pwild2024.09 | 81.4 | 92.5 | 12.05 | 98.25 | |
| MixupMethod Category=OOD generalization2024.09 | 79.17 | 93.3 | 58.24 | 75.7 | |
| MixupMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 79.17 | 93.3 | 58.24 | 75.7 | |
| SharpDROMethod Category=OOD generalization2024.09 | 79.03 | 94.91 | 42.94 | 89.99 | |
| SharpDROMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 79.03 | 94.91 | 42.94 | 89.99 | |
| IRMMethod Category=OOD generalization2024.09 | 77.92 | 90.85 | 59.42 | 87.81 | |
| IRMMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 77.92 | 90.85 | 59.42 | 87.81 | |
| VREXMethod Category=OOD generalization2024.09 | 76.9 | 91.35 | 65.45 | 85.46 | |
| VREXMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 76.9 | 91.35 | 65.45 | 85.46 | |
| EQRMMethod Category=OOD generalization2024.09 | 75.71 | 92.93 | 57.18 | 89.11 | |
| EQRMMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 75.71 | 92.93 | 57.18 | 89.11 | |
| MSPMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 59.28 | 88.5 | |
| ODINMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 49.12 | 84.97 | |
| EnergyMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 52.79 | 85.22 | |
| MahalanobisMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 15 | 97.33 | |
| ViMMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 29.35 | 93.7 | |
| KNNMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 39.5 | 92.73 | |
| ASHMethod Category=OOD detection2024.09 | 75.05 | 94.84 | 53.37 | 85.63 | |
| ERMMethod Category=OOD generalization2024.09 | 75.05 | 94.84 | 52.79 | 85.22 | |
| MSPMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 52.79 | 85.22 | |
| ODINMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 51.24 | 84.97 | |
| EnergyMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 52.79 | 85.22 | |
| MahalanobisMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 16.42 | 97.33 | |
| ViMMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 26.26 | 93.7 | |
| KNNMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 29.35 | 92.73 | |
| ASHMethod Category=OOD detection, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 45.27 | 85.63 | |
| ERMMethod Category=OOD generalization, Backbone=Wide ResNet-40-22024.10 | 75.05 | 94.84 | 52.79 | 85.22 | |
| Energy (w. outlier)Method Category=Learning w. Pwild2024.09 | 49.34 | 94.68 | 16.42 | 96.46 | |
| Energy (w. outlier)Method Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 49.34 | 94.68 | 16.42 | 96.46 | |
| OEMethod Category=Learning w. Pwild2024.09 | 44.71 | 92.84 | 29.36 | 93.93 | |
| OEMethod Category=Learning w. Pwild, Backbone=Wide ResNet-40-22024.10 | 44.71 | 92.84 | 29.36 | 93.93 |