MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PS-MNIST
98.7Accuracy
9
MNIST
88Data Required (25th Percentile)
9
MNIST (test)
71.35Accuracy (rho=0.4, zeta=0.8)
9
MNIST-LT (test)
0.888Macro F1
9
MNIST-LT
88.22Recall
9
MNIST (unseen classes 5-9)
89.47Accuracy
9
MNIST Digit 8 (test)
0.011KLD
9
MNIST Digit 3 (test)
0.016KLD
9
MNIST Digit 1 (test)
0.012KLD
9
mnist
85.3AMI
9
MNIST
99.13Accuracy
9
MNIST ID (test)
0.14ECE
9
MNIST
97.19Accuracy (alpha=0.1)
9
MNIST dynamically binarized (train)
-97.21Training ELBO
9
MNIST multi-task (test)
94.62Accuracy
9
MNIST
6.38Wall-clock Speedup
9
MNIST Square shift
0.022Classification Error Rate
9
MNIST Monotone shift
2.5Classification Error
9
MNIST 1k
0.667NMI
9
MNIST downsampled (test)
0.11Log Z Absolute Error
9
MNIST 75SP
88.54AUC
9
MNIST standard (test)
98.87Clean Accuracy
9
MNIST
0.995Class 0 AUC
9
MNIST -> USPS (target)
97.3Accuracy
9
MNIST
7.48Runtime (s)
9