CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 (test)
123Communication Rounds
12
CIFAR-10 (test)
131Communication Rounds
12
CIFAR-10 (test)
68.99Accuracy
12
CIFAR-100 TSS NATS-Bench (non-stratified)
78.7Mean Absolute Spearman Correlation
12
CIFAR-10 TSS NATS-Bench (non-stratified)
79.6Mean Abs Spearman Correlation
12
CIFAR-10 SSS NATS-Bench (non-stratified)
5.9Mean Absolute Spearman Correlation
12
CIFAR100 LT
81.93AUC
12
CIFAR10-LT p = 50 (test)
95.14AUC
12
CIFAR10 LT (test)
93.55AUROC
12
CIFAR-10 + CIFAR-100
94Accuracy
12
CIFAR-10 label shift (test)
65.96Top-1 Accuracy
12
CIFAR-10 9 classes
96AUROC
12
CIFAR-10 (test)
84.82Accuracy
12
CIFAR-100 (test)
13.37Accuracy
12
CIFAR-100 C
60.63Accuracy
12
CIFAR-10-C
85.77Accuracy
12
CIFAR-100
71.72Accuracy
12
CIFAR-10
94.07Accuracy
12
CIFAR-100N 1.0 (test)
62.34Accuracy (Noisy)
12
CIFAR-10 alpha=10.0 (test)
92.19Accuracy
12
CIFAR-10 alpha=1.0 (test)
91.76Accuracy
12
CIFAR-10 alpha=0.3 (test)
90.43Test Accuracy
12
CIFAR-10 (test)
92.19Classification Accuracy
12
CIFAR-100
60.1Natural Accuracy
12
CIFAR-100 (test)
81.91PMD Accuracy (35%)
12