CINIC
Benchmarks
TaskDatasetSOTA resultTrendResults
CINIC-10 (test)
95.8Accuracy
177
CINIC-10
65Accuracy
59
CINIC-10
100Accuracy
42
CINIC-10 1.0 (10% label)
81.29Accuracy
42
CINIC-10 Dir(0.01), 50 clients, 20% participation
56.96Accuracy
36
CINIC-10 iid (test)
50.51Test Accuracy
34
CINIC10 (CN10)
1.5TPR @ 0.1% FPR
28
CINIC-10 Dir(0.5) (test)
62.56Accuracy
28
CINIC-10 Dir(0.5)
62.96Accuracy
28
CINIC-10 under sudden drift and Dir(0.1) 1.0 (test)
46.02Generalized Accuracy
27
CINIC-10 non-iid
37.59Accuracy
26
CINIC10
69.09Accuracy
14
CINIC-10 20 clients (test)
51.12Accuracy
14
CINIC-10 N=100 VGG-11 (test)
32.1Max Latency
12
CINIC-10
67Accuracy
10
CINIC FCN PGDL tasks (train test)
16.93CMI Score
10
CINIC-10
0.817AUC
8
CINIC-10
81.67AUC
8
CINIC-10
0.081Delta AUC
8
CINIC10
5Communication Rounds
7
CINIC10 Bernoulli shift
25.63Average Error
7
CINIC10 Linear shift
26.21Average Error
7
CINIC10 Square shift (test)
25.56Average Error
7
CINIC-10 (test)
104Communication Rounds
6
CINIC-10 (test)
4.76Avg Poison Success
6