Out-of-Distribution Detection on MNIST vs FASHIONMNIST (test)
0.99AUROCDE
Evaluation Results
| Method | Links | |
|---|---|---|
| DEMemory budget=10p2024.09 | 0.99 | |
| Sketched Lanczos UncertaintyMemory budget=10p2024.09 | 0.95 | |
| LLA-DMemory budget=10p2024.09 | 0.94 | |
| LLA-DModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.94 | |
| Deep EnsembleModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.94 | |
| DEMemory budget=10p2024.09 | 0.9 | |
| SCODMemory budget=10p2024.09 | 0.89 | |
| MC-DropoutUncertainty Metric=Predictive Entropy2021.06 | 0.888 | |
| LLAMemory budget=10p2024.09 | 0.88 | |
| LEMemory budget=10p2024.09 | 0.88 | |
| LE-HMemory budget=10p2024.09 | 0.88 | |
| ReDecNNUncertainty Metric=Predictive Entropy2021.06 | 0.812 | |
| SWAGMemory budget=10p2024.09 | 0.77 | |
| LLA-DMemory budget=10p2024.09 | 0.68 | |
| EnsembleUncertainty Metric=Predictive Entropy, Ensemble Size=D2021.06 | 0.534 | |
| SWAGModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.29 | |
| Sketched Lanczos UncertaintyMemory budget=10p2024.09 | 0.28 | |
| LLAMemory budget=10p2024.09 | 0.27 | |
| LEMemory budget=10p2024.09 | 0.27 | |
| LE-HMemory budget=10p2024.09 | 0.27 | |
| SCODMemory budget=10p2024.09 | 0.27 | |
| LLAModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.27 | |
| LEModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.27 | |
| LE-HModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.27 | |
| SCODModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.27 | |
| SWAGMemory budget=10p2024.09 | 0.26 | |
| Sketched Lanczos UncertaintyModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.09 | 0.26 |