List your company
ResearchFormerly WizWand

Out-of-Distribution Detection on MNIST vs FASHIONMNIST (test)

0.99AUROCDE
0.23080.42790.6250.8221Jun 1, 2021Dec 19, 2021Jul 9, 2022Jan 27, 2023Aug 16, 2023Mar 5, 2024Sep 23, 2024
Updated 8mo ago

Evaluation results

MethodLinks
DEMemory budget=10p2024.090.99
Sketched Lanczos UncertaintyMemory budget=10p2024.090.95
LLA-DMemory budget=10p2024.090.94
LLA-DModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.94
Deep EnsembleModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.94
DEMemory budget=10p2024.090.9
SCODMemory budget=10p2024.090.89
MC-DropoutUncertainty Metric=Predictive Entropy2021.060.888
LLAMemory budget=10p2024.090.88
LEMemory budget=10p2024.090.88
LE-HMemory budget=10p2024.090.88
ReDecNNUncertainty Metric=Predictive Entropy2021.060.812
SWAGMemory budget=10p2024.090.77
LLA-DMemory budget=10p2024.090.68
EnsembleUncertainty Metric=Predictive Entropy, Ensemble Size=D2021.060.534
SWAGModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.29
Sketched Lanczos UncertaintyMemory budget=10p2024.090.28
LLAMemory budget=10p2024.090.27
LEMemory budget=10p2024.090.27
LE-HMemory budget=10p2024.090.27
SCODMemory budget=10p2024.090.27
LLAModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.27
LEModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.27
LE-HModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.27
SCODModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.27
SWAGMemory budget=10p2024.090.26
Sketched Lanczos UncertaintyModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.26