OOD Detection on CIFAR-100 (test)
98.24AUROC (%)DiverseMix
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DiverseMixBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 98.24 | 8.51 | 74.6 | 98.46 | |
| DiverseMixBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 98.24 | 8.51 | 74.6 | 98.46 | |
| POEMBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 97.79 | 15.14 | 73.41 | 98.31 | |
| POEMBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 97.79 | 15.14 | 73.41 | 98.31 | |
| NTOMBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 96.69 | 18.77 | 74.52 | 96.49 | |
| NTOMBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 96.69 | 18.77 | 74.52 | 96.49 | |
| EnergyBackbone=DenseNet, uses_auxiliary_outliers=true, mode=w. Daux2024.11 | 96.68 | 19.25 | 72.39 | 97.44 | |
| EnergyBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 96.68 | 19.25 | 72.39 | 97.44 | |
| SOFLBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 96.32 | 19.32 | 73.93 | 96.99 | |
| SOFLBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 96.32 | 19.32 | 73.93 | 96.99 | |
| CCUBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 95.02 | 19.27 | 74.49 | 95.41 | |
| CCUBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 95.02 | 19.27 | 74.49 | 95.41 | |
| DivOEBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 95 | 18.91 | 74.08 | 95.26 | |
| DivOEBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 95 | 18.91 | 74.08 | 95.26 | |
| OEBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 94.93 | 19.54 | 74.25 | 95.26 | |
| OEBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 94.93 | 19.54 | 74.25 | 95.26 | |
| MixOEBackbone=DenseNet, uses_auxiliary_outliers=true2024.11 | 92.93 | 27.71 | 75.15 | 93.81 | |
| MixOEBackbone=DenseNet-101, Using Auxiliary OOD Data=true2024.11 | 92.93 | 27.71 | 75.15 | 93.81 | |
| ATOMAttack Scenario=Clean, Attack Type=None2022.09 | 92.5 | — | — | — | |
| OEBackbone=WRN2023.03 | 90.07 | 49.02 | — | 97.67 | |
| ASH-SBackbone=DenseNet-1012022.09 | 90.02 | 41.4 | — | — | |
| SSD+Backbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 88.91 | 38.32 | — | 89.77 | |
| SSD+Backbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 88.91 | 38.32 | — | 89.77 | |
| LINeBackbone=DenseNet2023.03 | 88.67 | 35.67 | — | — | |
| OEBackbone=DenseNet2023.03 | 88.51 | 53.03 | — | 97.25 | |
| ASH-BBackbone=DenseNet-1012022.09 | 88.04 | 48.73 | — | — | |
| ATDAttack Scenario=Clean, Attack Type=None2022.09 | 87.7 | — | — | — | |
| DICEBackbone=DenseNet2023.03 | 87.23 | 49.72 | — | — | |
| DICEBackbone=DenseNet-1012022.09 | 87.23 | 49.72 | — | — | |
| LogitNormBackbone=WRN2023.03 | 86.6 | 57.38 | — | 96.8 | |
| OEBackbone=ResNet2023.03 | 86.33 | 59.85 | — | 96.47 | |
| MahalanobisBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 85.71 | 47.89 | 74.05 | 87.15 | |
| MahalanobisBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 85.71 | 47.89 | 74.05 | 87.15 | |
| DICE + ReActBackbone=DenseNet2023.03 | 85.08 | 49.57 | — | — | |
| MOODArchitecture=MSDNet (dynamic exit), FLOPs=0.79e82021.04 | 84.97 | 57.22 | 75.26 | — | |
| ODINArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 84.89 | 57.45 | 75.43 | — | |
| ODINBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 84.89 | 56.31 | 74.05 | 85.88 | |
| ODINBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 84.89 | 56.31 | 74.05 | 85.88 | |
| OpenMixBackbone=WRN2023.03 | 84.88 | 68.87 | — | 96.55 | |
| ODINArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 84.66 | 57.22 | 76.9 | — | |
| EnergyArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 84.51 | 59.15 | 75.43 | — | |
| ODINBackbone=DenseNet2023.03 | 84.49 | 58.14 | — | — | |
| ODINBackbone=DenseNet-1012022.09 | 84.49 | 58.14 | — | — | |
| ReActBackbone=DenseNet2023.03 | 84.47 | 62.27 | — | — | |
| ReActBackbone=DenseNet-1012022.09 | 84.47 | 62.27 | — | — | |
| EnergyArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 83.69 | 62.71 | 76.9 | — | |
| MahalanobisArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 83.19 | 53.52 | 76.9 | — | |
| MahalanobisBackbone=DenseNet2023.03 | 82.73 | 55.37 | — | — | |
| MahalanobisBackbone=DenseNet-1012022.09 | 82.73 | 55.37 | — | — | |
| ASH-PBackbone=DenseNet-1012022.09 | 82.71 | 64.53 | — | — | |
| LogitNormBackbone=ResNet2023.03 | 82.5 | 63.49 | — | 95.43 | |
| LogitNormBackbone=DenseNet2023.03 | 82.1 | 61.56 | — | 95.16 | |
| Vanilla2025.04 | 82.03 | 89.26 | — | — | |
| FMFPBackbone=WRN2023.03 | 81.54 | 70.98 | — | 95.71 | |
| EnergyBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 81.5 | 65.87 | 74.05 | 84.07 | |
| EnergyBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 81.5 | 65.87 | 74.05 | 84.07 | |
| BalCAL2025.04 | 81.26 | 76.03 | — | — | |
| OpenMixBackbone=DenseNet2023.03 | 81.23 | 66.63 | — | 95.3 | |
| EnergyBackbone=DenseNet2023.03 | 81.19 | 68.45 | — | — | |
| Energy scoreBackbone=DenseNet-1012022.09 | 81.19 | 68.45 | — | — | |
| EnergyBackbone=DenseNet2023.03 | 80.87 | 68.36 | — | 94.86 | |
| ODINBackbone=DenseNet2023.03 | 80.53 | 69.44 | — | 94.78 | |
| MaxLogitBackbone=DenseNet2023.03 | 80.48 | 69.85 | — | 94.77 | |
| EnergyBackbone=WRN2023.03 | 79.89 | 74.93 | — | 94.66 | |
| MaxLogitBackbone=WRN2023.03 | 79.75 | 75.27 | — | 94.67 | |
| ODINBackbone=WRN2023.03 | 79.57 | 76.03 | — | 94.59 | |
| MSPArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 78.33 | 76.71 | 75.43 | — | |
| MSPBackbone=WRN2023.03 | 77.96 | 77.53 | — | 94.36 | |
| FMFPBackbone=DenseNet2023.03 | 77.56 | 72.87 | — | 94.19 | |
| MSPArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 77.1 | 77.51 | 76.9 | — | |
| CRLBackbone=WRN2023.03 | 76.81 | 79.08 | — | 94.22 | |
| MSPBackbone=DenseNet2023.03 | 76.79 | 77.03 | — | 93.94 | |
| MaxLogitBackbone=ResNet2023.03 | 76.61 | 74.45 | — | 93.66 | |
| ODINBackbone=ResNet2023.03 | 76.55 | 74.3 | — | 93.54 | |
| EnergyBackbone=ResNet2023.03 | 76.43 | 74.42 | — | 93.59 | |
| CRLBackbone=DenseNet2023.03 | 76.41 | 75.77 | — | 93.85 | |
| OpenMixBackbone=ResNet2023.03 | 75.95 | 74.66 | — | 93.56 | |
| PLP2025.04 | 75.62 | 83.12 | — | — | |
| MSPBackbone=DenseNet2023.03 | 74.36 | 80.13 | — | — | |
| Softmax scoreBackbone=DenseNet-1012022.09 | 74.36 | 80.13 | — | — | |
| MSPBackbone=ResNet2023.03 | 74.21 | 81.68 | — | 93.34 | |
| ATDAttack Scenario=Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 73.9 | — | — | — | |
| MahalanobisArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 73.8 | 78.06 | 75.43 | — | |
| VTST2025.04 | 73.42 | 84.93 | — | — | |
| ATDAttack Scenario=In, Attack Type=PGD-100, Epsilon=8/2552022.09 | 73.4 | — | — | — | |
| MSPBackbone=DenseNet, uses_auxiliary_outliers=false2024.11 | 73.13 | 80.3 | 74.05 | 76.97 | |
| MSPBackbone=DenseNet-101, Using Auxiliary OOD Data=false2024.11 | 73.13 | 80.3 | 74.05 | 76.97 | |
| FMFPBackbone=ResNet2023.03 | 72.92 | 80.19 | — | 92.94 | |
| ATOMAttack Scenario=Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 72.8 | — | — | — | |
| CRLBackbone=ResNet2023.03 | 72.72 | 81.67 | — | 92.69 | |
| TST2025.04 | 71.27 | 85.6 | — | — | |
| ATDAttack Scenario=In and Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 55.3 | — | — | — | |
| ATOMAttack Scenario=In, Attack Type=PGD-100, Epsilon=8/2552022.09 | 8.9 | — | — | — | |
| ATOMAttack Scenario=In and Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 8.5 | — | — | — |