CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 (test)
94.8Accuracy (Clean)
3
CIFAR-10 (train)
-1,978.91Negative Log-Likelihood
3
CIFAR-100 (test)
10.7Test Error
3
Sequential CIFAR-10 (test)
73.42Accuracy
3
CIFAR-100 (Last 100 episodes)
0.775Average Cost
3
CIFAR-100 (All episodes)
0.838Average Cost
3
CIFAR-10 (test)
23.5Budget Used (%)
2
CIFAR-100 (Session 4)
63.56Accuracy (All)
2
CIFAR-100 AA adversarial (test)
37.71AURC
2
CIFAR-100
88.54Accuracy
2
CIFAR-10
96.5Delta H@1
2
CIFAR-10
84.67Top-1 Accuracy
2
CIFAR-10N
87.95F1 Score
2
CIFAR-10 Merge Imbalance (pool)
86.19Balanced Accuracy (10% cost)
2
CIFAR100
0.29L(x) Value
2
CIFAR-10
84.6Accuracy
2
CIFAR-10 (test)
97.18Top-1 Accuracy
2
CIFAR10
33.5Error Rate
2
CIFAR100
1.375NLL
2
CIFAR10
0.339NLL
2
CIFAR-100 (test)
4.61Average Accuracy
2
CIFAR-10
95.45Average Coverage
2
CIFAR-100
89.28AUPR
2
CIFAR-100 Cross-Device 100 clients
1Average TPR
2
CIFAR-100 Cross-Silo 10 clients
100Average TPR
2