CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 1 class forget
67Forgetting Accuracy
11
CIFAR-10 single-class forgetting
90.5Accuracy F
11
CIFAR-10 Upstream 1.0 (train)
97.6TPR
11
CIFAR10C 5% bias ratio unbiased (test)
59.66Accuracy
11
CIFAR10C 1% bias ratio unbiased (test)
46.18Accuracy
11
CIFAR10C 0.5% bias ratio unbiased (test)
38.74Accuracy
11
CIFAR-10 (test)
94.9Seen Acc
11
CIFAR100
3.47Speedup
11
CIFAR-10 LDA alpha=0.1 (test)
90.5Accuracy
11
CIFAR100 0.6
39.7Acc_g
11
CIFAR100 0.1
34.79Accuracy (Global)
11
CIFAR-10-C target clients
81.96Accuracy
11
CIFAR-10 l2 threat model, epsilon=0.5 (test)
96.09Standard Accuracy
11
CIFAR100 Long-Tailed (imbalance ratio 50) (test)
81.38AUROC
11
CIFAR100 Long-Tailed (imbalance ratio 100) (test)
75.85AUROC
11
CIFAR Macro search space
0.979Spearman Correlation
11
CIFAR-10-N
95.9Accuracy (20)
11
CIFAR10
96.7Agreement
11
CIFAR-10-FSGAN
95.1AUROC
11
CIFAR-10-FSDE
96.4AUROC
11
CIFAR-10vs100
0.9AUROC
11
CIFAR-100 (test)
68.26Linear Top-1 Acc
11
CIFAR10 pathological non-IID (500 clients, 80 samples)
90.81Top-1 Acc
11
CIFAR10 pathological non-IID (100 clients, 400 samples)
93.25Top-1 Acc
11
CIFAR10 symmetric noise 0.2 Dirichlet non-IID (a=100) (test)
31ECE
11