MNIST
Benchmarks
TaskDatasetSOTA resultTrendResults
MNIST (test)
97.6Robust Accuracy
35
MNIST (test)
98.61Average Accuracy
35
MNIST (test)
99.32N-ELBO
35
MNIST (test)
0.03NLL
34
MNIST Dirichlet shift alpha=1 (val)
0.44MSE (10^-3)
34
MNIST
82.45ASR
34
MNIST to USPS
98.2Accuracy
34
MNIST (test)
0.57Error Rate
34
MNIST CNN 4-Layer
86Cert. Coverage
33
MNIST LQ-3 partition (test)
94.384Accuracy
33
MNIST LQ-2 partition (test)
90.604Accuracy
33
MNIST LQ-1 partition (test)
82.808Accuracy
33
MNIST Severe Non-IID (Dirichlet α = 0.1)
4Communication Rounds
33
MNIST Severe Non-IID
24Communication Cost (MB)
33
Sequential-MNIST
0.04Forgetting
33
Original MNIST 17 (test)
93.11Accuracy
33
MNIST
0.21ECE
33
MNIST Strokes
50Samples Triggering Refinement
32
MNIST Random-Label
95.5Average Accuracy
32
MNIST (test)
99.5Test Accuracy
32
MNIST few-shot
96.6Accuracy (few-shot)
32
MNIST (test)
1.29Offline Running Time (s)
32
P-MNIST
95.97Accuracy
32
Permuted MNIST
87.2Average Accuracy
32
MNIST (test)
99.5Robustness Score
32