FEMNIST
Benchmarks
TaskDatasetSOTA resultTrendResults
FEMNIST (test)
97.31Accuracy
104
FEMNIST
92.56Accuracy
50
FEMNIST (LEAF) (test)
82.45Accuracy
39
FEMNIST natural partition (test)
76.3MIA Accuracy
24
FEMNIST (natural partition)
100PPS
20
FEMNIST C=10 original (test)
82.4Accuracy
17
FEMNIST (train)
72.72Accuracy
14
FEMNIST (test)
70.6Mean Accuracy
14
FEMNIST (non-iid)
84Accuracy
13
FEMNIST
24.18PSNR
12
FEMNIST realistic non-IID LEAF benchmark (test)
85.2Top-1 Acc
11
FEMNIST
398Average Unlearning Time (s)
10
FEMNIST LEAF
80.61Accuracy
10
FEMNIST Practical
100Mean Accuracy
9
FEMNIST 10 new writers (test)
88.18Overall Accuracy
9
FEMNIST
53.6MIA Accuracy
8
FEMNIST non-i.i.d.
14.76Test Error
8
FEMNIST i.i.d.
14.79Test Error Rate
8
FEMNIST non-i.i.d.
14.76Test Error Rate
8
FEMNIST (i.i.d.)
14.79Test Error
8
FEMNIST (test)
65.04Accuracy
7
FEMNIST (test)
80.6Accuracy (alpha=0.1)
7
FEMNIST 7 (test)
79.9Avg Accuracy
7
FEMNIST
73.5Clean Accuracy
6
FEMNIST Dir-0.1 (test)
86.3Accuracy
6