MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST
99.28Accuracy
5
MNIST (test)
99.69Test Accuracy (Avg)
5
MNIST
10.8Accuracy
5
MNIST
0.94LCOS
5
MNIST Class-prior Shift 10 (test)
90.2Mean Accuracy
5
MNIST (subsampled)
1Normalized Clustering Loss
5
MNIST d = 785
1,053.455Max ESS
5
MNIST (test)
0.988AUPRC
5
MNIST (test)
0MSE
5
MNIST 5-task incremental setting (test)
98.85Avg Accuracy
5
MNIST (test)
99.65SNN Accuracy
5
MNIST-Hard (test)
99.9Localization Accuracy
5
MNIST
4.65Runtime
5
MNIST
0.991Trustworthiness
5
MNIST
76.93NLL (nats)
5
MNIST
98AUPCc'
5
MNIST
100Success Rate
5
mnist (test)
93.2Avg AUC
5
MNIST OOD (test)
97.3Top-1 Acc (25%)
5
MNIST Many Permutations
50.81Retained Accuracy (RA)
5
MNIST Permutations
76.88Retained Accuracy
5
MNIST → MNIST-M (test)
0.878Macro Avg Acc
5
MNIST Resnet18 (test)
87Accuracy
5
MNIST LeNet5 (test)
85Accuracy
5
MNIST (test)
98.7Recall@1
5