MNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MNIST Meta-Dataset (unseen)
98.7Recall@1
5
MNIST 75 (test)
96.19Accuracy
5
MNIST 70000x784
87Runtime (s)
5
MNIST (test)
1.7Average Rank
5
MNIST out-of-domain
95.7Accuracy
5
MNIST-P
82.58Accuracy
5
MNIST (test)
1Error Rate
5
MNIST statically binarized
83.32Negative ELBO
5
MNIST
186Training Time (s)
5
Permuted pixel-by-pixel MNIST (evaluation)
94.1Accuracy
5
MNIST Permuted pixel-by-pixel (val)
94.7Accuracy
5
Unpermuted pixel-by-pixel MNIST (evaluation)
98.2Accuracy
5
MNIST Unpermuted pixel-by-pixel (val)
98.5Accuracy
5
MNIST (test)
0.927Probe Score (2D)
5
MNIST 100 labels (test)
0.89Test Error
5
Shuffled MNIST (val)
1Accuracy (Kendall's tau)
5
MNIST 100 images
96Success Rate
5
MNIST 50% label noise (test)
99.3Test Accuracy
5
MNIST 25% label noise (test)
99.3Test Accuracy
5
MNIST L2 norm first 100 examples (test)
99Certified Ratio
5
MNIST
0.277KL Divergence (0.01)
5
MNIST GNNBenchmark (test)
98.414Accuracy
5
MNIST (test)
99Accuracy
4
MNIST
0.052FID
4
MNIST CNN (test)
0.523RMIA AUC
4