CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 IR=10, NR=0.0 (test)
36.7Top-1 Error Rate
8
CIFAR-100 IR=1, NR=0.0 (test)
22.2Top-1 Error Rate
8
CIFAR100 100 clients (test)
53.24Test Accuracy
8
CIFAR100 50 clients (test)
60.17Test Accuracy
8
CIFAR10 50 clients (test)
0.901Accuracy (Test)
8
CIFAR10 10 clients (test)
92.47Accuracy
8
CIFAR-10 Unbalanced (val)
22.08Top-1 Error (Long-tail, Ratio 100)
8
CIFAR-100-LT Imbalanced factor 200 (test)
47.8Top-1 Accuracy
8
CIFAR-10 2k labels (test)
11.87Test Error Rate
8
CIFAR-100 Gaussian
99.65AUROC
8
CIFAR-10 (test)
3,058Test Log Likelihood (nats)
8
CIFAR-10 (test)
3,049Log Likelihood (nats)
8
CIFAR-10
4.3Bits per Pixel
8
CIFAR100 (test)
71.23Top-1 Acc (Symmetric, 0.2)
8
CIFAR100 (full)
27.5Clustering Accuracy
8
CIFAR10 (full)
46.9Clustering Accuracy
8
CIFAR-100 (Pat-10)
113Communication Rounds (acc@65)
8
Split CIFAR
74.11Accuracy
8
nCIFAR-10
60.5Test Accuracy
8
CIFAR10 mu=1 (test)
92.95Accuracy
8
CIFAR10 (test)
84.67Accuracy
8
CIFAR10 (test)
3.8Generalization Bound
7
CIFAR100
70.03Accuracy
7
CIFAR10
58F1 Score
7
CIFAR-10
-23.24Mean Acc Delta
7