EMNIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
EMNIST (test)
94.63Accuracy
272
EMNIST Balanced
91.06Accuracy
103
EMNIST
98.9Accuracy
90
EMNIST
100TPR
49
EMNIST Dir(0.1) (test)
96.55Test Accuracy
41
EMNIST-L (test)
94.81Top-1 Acc
36
EMNIST Balanced (test)
91.06Accuracy
34
EMNIST Letters 4 (test)
67.42Accuracy
33
EMNIST Dir(0.5) (test)
91.82Test Accuracy
31
E-MNIST
95.5Accuracy
25
M(EMNIST-20, F-EMNIST)
97.12Accuracy
22
EMNIST
10ASR
21
EMNIST Close-world (test)
83.79Accuracy
20
EMNIST (test)
0.001MSE
17
emnist
41.2ARI
17
EMNIST 20 tasks
88.5Average Accuracy
15
EMNIST Letters (test)
95.96Accuracy
15
EMNIST-Letters (test)
95.88Accuracy
15
EMNIST (Shards)
1RES
14
EMNIST Dirichlet
100RES
14
EMNIST (IID)
100RES
14
EMNIST Letters
81.4Clean Accuracy
14
EMNIST label-permuted 5M interactions 2000 tasks (streaming)
80.7Average Online Accuracy
14
EMNIST Private Task Finetuned (test)
85Accuracy
14
EMNIST Public Task Finetuned (test)
88.5Accuracy
14