CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 ResNet-20 (test)
60.46Retention Accuracy
24
CIFAR-100 Non-IID 10 Clients
75Test Accuracy
24
CIFAR-10 30% random data forgetting
0Average Gap
24
CIFAR-100 (test)
63.33Accuracy (Test)
24
CIFAR-100 initial (test)
57.8Accuracy
24
CIFAR-10
95.7Accuracy
24
CIFAR-100 (test)
75.29Accuracy
24
CIFAR-10 (test)
93.68Top-1 Accuracy
24
CIFAR-10
0.96OOD AUROC
24
CIFAR-10
0.185NLL
24
CIFAR-10 (test)
95.57Standard Accuracy
24
CIFAR-10
0.72Communication Cost (GB)
24
CIFAR-10
76.41Accuracy
24
CIFAR-10 (test)
91.33Class Accuracy: airplane
24
CIFAR-100
95,448Noise Scale (L2)
24
CIFAR-100 VTAB-1K
79Accuracy
24
CIFAR-10 (test)
2.42NLL (BPD)
24
CIFAR-100 Split
28.15Final Accuracy
24
CIFAR-10 (ID) vs 6 OOD datasets (Textures, SVHN, Place365, LSUN-C, LSUN-R, iSUN) (test)
3.49FPR@95
24
CIFAR-10 binary imbalanced, 1:100 ratio (test)
42.8FPR @ 98% TPR
24
CIFAR-100 (test)
83.3Top-1 Acc
24
CIFAR-10-LT gamma=150 (test)
81.3Accuracy
24
CIFAR-10
100ASR
24
CIFAR-100 1.0 (val)
54.3Accuracy
24
CIFAR10 1000 images (test)
72.3Robust Accuracy
24