MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST (test)
99.52Accuracy
61
MNIST
99.8Backdoor Attack Success Rate
60
MNIST
72.16Clustering Accuracy
60
MNIST (val)
99.82Accuracy
58
MNIST i.i.d. (test)
97.053Test Accuracy
54
MNIST → USPS (test)
83.07mAP
52
MNIST → USPS
88.71MAP
52
MNIST (test)
-96.32Negative ELBO
52
MNIST (train)
136.73ELBO
51
MNIST 5 tasks (test)
1.4Average Forgetting Rate
51
MNIST Sequential (test)
99.48Accuracy
51
MNIST (test)
69Clean Error
50
MNIST
0.51Clean Error Rate
50
MNIST
76.93NLL (nats)
50
MNIST Permuted Sequential
99.1Test Accuracy Mean
50
Split MNIST
99.9Average Accuracy
49
MNIST
99.28Accuracy
48
MNIST
0.527Mean Valuation
48
MNIST dynamically binarized (test)
82.9Log-Likelihood
48
MNIST (median)
95.4Median Accuracy
47
MNIST
0.985AUC
47
MNIST one-class classification
0.994AUROC
47
MNIST to MNIST-M (test)
99.4Acc (Target)
47
MNIST
0.01MSE
46
MNIST original (test)
99.72Accuracy
46