OOD Detection on CIFAR-10 (AUROC, Train Time, Test Time)
0.96OOD AUROCVaLLA 200
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VaLLA 200Backbone=ResNet-562026.02 | 0.96 | 26,300 | 363.8 | |
| GAPA (ours)Backbone=ResNet-562026.02 | 0.953 | 10.29 | 3.3 | |
| Sampled LLABackbone=ResNet-562026.02 | 0.944 | 14,600 | 2,840 | |
| SNGPBackbone=ResNet-562026.02 | 0.94 | 43.5 | 3.01 | |
| GP (subset)Backbone=ResNet-562026.02 | 0.936 | 8,420 | 382 | |
| LLA*Backbone=ResNet-562026.02 | 0.934 | 5,550 | 1.16 | |
| LLA* KFACBackbone=ResNet-562026.02 | 0.933 | 62.2 | 2.18 | |
| GAPA (ours)Backbone=ResNet-442026.02 | 0.931 | 8.03 | 2.85 | |
| MF-VIBackbone=ResNet-562026.02 | 0.929 | 1.97 | 1.18 | |
| VaLLA 200Backbone=ResNet-442026.02 | 0.928 | 16,700 | 272.9 | |
| MAPBackbone=ResNet-562026.02 | 0.924 | — | 0.949 | |
| ELLABackbone=ResNet-562026.02 | 0.924 | 1,130 | 91 | |
| LLA DiagBackbone=ResNet-562026.02 | 0.923 | 40.67 | 1.12 | |
| LLA KFACBackbone=ResNet-562026.02 | 0.917 | 71.3 | 4.13 | |
| SNGPBackbone=ResNet-442026.02 | 0.901 | 35 | 2.89 | |
| Sampled LLABackbone=ResNet-442026.02 | 0.899 | 11,000 | 2,510 | |
| GP (subset)Backbone=ResNet-442026.02 | 0.897 | 8,250 | 357 | |
| LLA*Backbone=ResNet-442026.02 | 0.895 | 4,980 | 0.962 | |
| LLA* KFACBackbone=ResNet-442026.02 | 0.894 | 58 | 1.97 | |
| MF-VIBackbone=ResNet-442026.02 | 0.89 | 1.63 | 1.03 | |
| MAPBackbone=ResNet-442026.02 | 0.885 | — | 0.761 | |
| ELLABackbone=ResNet-442026.02 | 0.885 | 1,120 | 78.3 | |
| LLA DiagBackbone=ResNet-442026.02 | 0.86 | 40.4 | 0.947 | |
| LLA KFACBackbone=ResNet-442026.02 | 0.855 | 63.1 | 3.62 |