OOD Detection on CIFAR-10 (test)
0.983AUROCATOM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ATOMAttack Scenario=Clean, Attack Type=None2022.09 | 0.983 | — | — | |
| LINeBackbone=DenseNet2023.03 | 0.9699 | 0.1471 | — | |
| DICE + ReActBackbone=DenseNet2023.03 | 0.9664 | 0.1648 | — | |
| DICEBackbone=DenseNet2023.03 | 0.9524 | 0.2083 | — | |
| ReActBackbone=DenseNet2023.03 | 0.9495 | 0.2645 | — | |
| EnergyBackbone=DenseNet2023.03 | 0.9457 | 0.2655 | — | |
| ATDAttack Scenario=Clean, Attack Type=None2022.09 | 0.943 | — | — | |
| ODINBackbone=DenseNet2023.03 | 0.9371 | 0.2457 | — | |
| MSPBackbone=DenseNet2023.03 | 0.9246 | 0.4873 | — | |
| MOODArchitecture=MSDNet (dynamic exit), FLOPs=0.79e82021.04 | 0.9126 | 0.2805 | 94.13 | |
| EnergyArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 0.9048 | 0.3362 | 94.09 | |
| ODINArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 0.9033 | 0.293 | 94.09 | |
| ODINArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 0.9011 | 0.3531 | 94.93 | |
| EnergyArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 0.9004 | 0.3526 | 94.93 | |
| MSPArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 0.8972 | 0.4987 | 94.09 | |
| MahalanobisArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 0.8933 | 0.3548 | 94.93 | |
| MahalanobisBackbone=DenseNet2023.03 | 0.8915 | 0.3142 | — | |
| MSPArchitecture=WideResNet-40-4, FLOPs=13.00e82021.04 | 0.8898 | 0.5681 | 94.93 | |
| ATDAttack Scenario=Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 0.862 | — | — | |
| ATDAttack Scenario=In, Attack Type=PGD-100, Epsilon=8/2552022.09 | 0.837 | — | — | |
| MahalanobisArchitecture=MSDNet Exit@last, FLOPs=1.05e82021.04 | 0.8284 | 0.7519 | 94.09 | |
| ATDAttack Scenario=In and Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 0.693 | — | — | |
| ATOMAttack Scenario=Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 0.447 | — | — | |
| ATOMAttack Scenario=In, Attack Type=PGD-100, Epsilon=8/2552022.09 | 0.156 | — | — | |
| ATOMAttack Scenario=In and Out, Attack Type=PGD-100, Epsilon=8/2552022.09 | 0.067 | — | — |