CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 multi-label 28 (beta=0.1, gamma=0.5)
0.922Macro AUC
8
CIFAR-100
73.99Top-1 Accuracy
8
CIFAR-10 noisy (test)
78.41Accuracy
8
CIFAR-100
59.85Top-1 Accuracy (NID1=0.05)
8
CIFAR-10
83.76Top-1 Accuracy (NID1, threshold 0.05)
8
CIFAR-10 AIRBench (val)
94.45Validation Accuracy
8
CIFAR-10
94Overall Accuracy
8
CIFAR-100 (retention split)
99.98Accuracy
8
CIFAR-10 (forget split)
100Accuracy
8
CIFAR-10 (retention split)
99.63Accuracy
8
CIFAR-100
0Delta AUC
8
CIFAR-10
0.037Delta AUC
8
CIFAR-10 Dir(0.5) (Original Clients)
74.8Test Accuracy
8
CIFAR-10 (E4b)
92Accuracy (C=2)
8
Corrupted-CIFAR10 rho=0.95 (unbiased test)
57.22Accuracy
8
CIFAR100 (test)
92Test Accuracy
8
CIFAR-10 LT (gamma=10, beta=2%) (test)
88.1Accuracy
8
CIFAR100
89.5Baseline mTA
8
CIFAR-10
57.73Robust Accuracy
8
CIFAR10
72.67Communication Rounds (Acc=75%)
8
CIFAR-10 (test)
95.19Standard Accuracy
8
CIFAR10
97.7Accuracy
8
CIFAR-10 (test)
100Attack Accuracy
8
CIFAR-100
1.167Latency (s)
8
CIFAR-10
99.2AUC (LSUN)
8