Out-of-distribution detection on CIFAR10 (ID) vs LSUN-Crop (OOD) (test)
0.26FPR@95DICE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DICEBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 0.26 | 99.92 | — | |
| GradOrthBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 0.81 | 99.78 | — | |
| ASH-SBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 0.9 | 99.73 | — | |
| GradNormBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 1.03 | 99.61 | — | |
| VRA-PBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 1.32 | 99.63 | — | |
| ASH-BBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 2.52 | 99.48 | — | |
| ASH-PBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 2.82 | 99.34 | — | |
| Energy scoreBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 3.81 | 99.15 | — | |
| ODINBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 4.7 | 98.86 | — | |
| ReActBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 5.96 | 98.84 | — | |
| Clipped HNNsScore=Energy score2021.07 | 9.48 | 98.21 | 99.63 | |
| Vanilla HNNScoring function=softmax score2021.07 | 22.22 | 96.05 | 99.16 | |
| Clipped HNNScoring function=softmax score2021.07 | 23.87 | 95.65 | 98.98 | |
| Vanilla HNNsScore=Energy score2021.07 | 24.78 | 95.06 | 98.92 | |
| FedSDWCalpha=0.12025.11 | 32.61 | 88.82 | — | |
| Softmax scoreBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 33.57 | 95.54 | — | |
| FOSTERalpha=0.12025.11 | 47.4 | 77.43 | — | |
| FedICONalpha=0.12025.11 | 48.22 | 81.28 | — | |
| FedATOLalpha=0.12025.11 | 49.5 | 86.22 | — | |
| FedLNalpha=0.12025.11 | 56.14 | 84.14 | — | |
| MahalanobisBackbone=DenseNet, In-Distribution Dataset=CIFAR-102023.08 | 56.55 | 86.96 | — | |
| FedTHEalpha=0.12025.11 | 58.14 | 82.04 | — | |
| PerAdaalpha=0.12025.11 | 69.35 | 71.84 | — | |
| FedIIRalpha=0.12025.11 | 79.48 | 63.31 | — | |
| FedAvgalpha=0.12025.11 | 83.41 | 58.05 | — | |
| ENNScoring function=softmax score2021.07 | 96.18 | 37.29 | 75.94 | |
| ENNsScore=Energy score2021.07 | 98.18 | 36.34 | 75.64 |