CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR10 Partial Class C=2
39.015Accuracy
15
CIFAR10 Partial Class C=5
56.174Accuracy
15
CIFAR-10 Pairflip Label Noise Globalized
64.88Accuracy
15
CIFAR-10 Pairflip Label Noise, Localized
61.52Accuracy
15
CIFAR-10 Symmetric Label Noise, Globalized
63.29Accuracy
15
CIFAR100 globalized pairflip label noise setting (test)
60.8Accuracy
15
CIFAR-100
86.27Average Robust Accuracy
15
CIFAR-100 Equally split
63.4Aavg
15
CIFAR-10
96.4Accuracy
15
CIFAR-10
1.02Infidelity
15
S-CIFAR-100 T=10
58.46Average Accuracy (A-bar)
15
S-CIFAR-100 15 (T=50)
24.11Last Accuracy (AT)
15
CIFAR-100 5 phases (test)
64.29Average Last Accuracy
15
CIFAR100
0.66Peak GPU Memory (GB)
15
CIFAR-10
100ASR
15
CIFAR-20 Sea sub-class
85.09Retained Accuracy (RA)
15
CIFAR-20 Rocket sub-class
85.26RA
15
CIFAR-10
100Retention Accuracy (RA)
15
CIFAR-100
76.81Retention Accuracy (RA)
15
CIFAR-100 LT (500:1 ratio) (test)
3.938Loss
15
CIFAR-100-LT (100:1 ratio) (test)
3.426Loss
15
CIFAR-10 (test)
92.6Accuracy
15
CIFAR-100
8.29ECE
15
CIFAR-10
8.63ECE
15
CIFAR-100 10 clients, heterog. (test)
46.6Test Accuracy
15