List your company
ResearchFormerly WizWand

Out-of-Distribution Detection on MNIST vs Rotation (test)

0.79AUROCDE
0.3740.4820.590.698Sep 23, 2024
Updated 8mo ago

Evaluation results

MethodLinks
DEMemory budget=10p2024.090.79
LLA-DMemory budget=10p2024.090.73
LLA-DModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.73
Deep EnsembleModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.71
Sketched Lanczos UncertaintyMemory budget=10p2024.090.61
Sketched Lanczos UncertaintyModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.59
SCODMemory budget=10p2024.090.54
LLAMemory budget=10p2024.090.52
LEMemory budget=10p2024.090.52
LE-HMemory budget=10p2024.090.52
SCODModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.51
LLAModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.49
LEModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.49
LE-HModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.49
SWAGModel Architecture=MLP, Parameters (p)=15K, Memory Budget=3p2024.090.41
SWAGMemory budget=10p2024.090.39