EMNIST
Benchmarks
TaskDatasetSOTA resultTrendResults
EMNIST IID
74.78Accuracy (Group [95%, 100%])
8
EMNIST
90.2Accuracy (Dirichlet, alpha=0.1)
8
EMNIST Non-IID (test)
79.3Time Reduction (%) @ Acc 0.6
8
EMNIST
0.091SS
8
EMNIST
96.47Robustness Accuracy (BA)
7
EMNIST iid (47 classes/client) CONV4, 50 rounds (test)
88.9Accuracy
7
EMNIST
98.51F1 Score
7
EMNIST ByClass (test)
1.54bpd
7
EMNIST Balanced (test)
1.6BPD
7
EMNIST Letters (test)
1.58Bits Per Dimension (bpd)
7
EMNIST MNIST (test)
1.52bpd
7
EMNIST (train)
0.997AUC
7
EMNIST Bymerge (test)
91.8Top-1 Accuracy
7
EMNIST Byclass (test)
88.43Top-1 Acc
7
EMNIST 8 (test)
83.5Average Accuracy
7
EMNIST (val)
86.2Accuracy
6
EMNIST ByClass letters (test)
2.34Bits Per Pixel
6
EMNIST letters 37 classes
33.78Accuracy
6
EMNIST mnist 10 classes
91.75Accuracy
6
EMnist
31.8SMD
6
EMNIST Balanced 69 (test)
85.95Accuracy
6
EMNIST 47 classes (SLS)
86.18Accuracy
5
EMNIST 47 classes (PLS)
82.41Test Accuracy
5
EMNIST 47 classes (Dir. (0.1))
85Test Accuracy
5
EMNIST 47 classes (Dir. (0.05))
83.15Test Accuracy
5