CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 (forget set)
18.511Avg Increase in Forget Accuracy
36
CIFAR-10
96AUROC
36
CIFAR-10
0.944Accuracy
36
CIFAR-100
94.14Accuracy
36
CIFAR-10 l=50000 (test)
96.47Accuracy
36
CIFAR-10 Dir(0.5) (test)
79.25Accuracy
36
CIFAR-100
72.67Accuracy
36
CIFAR-10 (test)
99.99Performance
36
CIFAR100
76.25Clean Accuracy
36
CIFAR100 (test)
6.16Relative Forgetting
36
CIFAR100 (test)
3.76Forgetting Measure
36
CIFAR100 Cross-Device (K=100) α = 0.1
41.56Accuracy
36
CIFAR10 Cross-Silo (K=10) α = 0.1
86.24Accuracy
36
CIFAR10 Cross-Device (K=100) α = 0.1
75.33Accuracy
36
CIFAR100 (test)
98.9Coverage
36
CIFAR-100 IDN
82.38Accuracy
36
CIFAR-10 IDN
97.73Accuracy
36
CIFAR-10
0.34FPR95 (SVHN)
36
CIFAR100 50 steps
81.74Last Accuracy
36
CIFAR-10
87.61P@1000
36
CIFAR10 (ID) vs CIFAR100 (OOD) (test)
98.52AUROC
36
CIFAR-10 (test)
100Noise Proportion
36
CIFAR-10 Symmetry-50% noise (test)
0.962Accuracy (Test)
36
CIFAR10
0.909Weighted Kendall's Tau
36
CIFAR100
1Weighted Kendall's Tau
36