CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 32x32 native (test)
4.1Total Comm. (GB)
4
CIFAR-10 standard (test)
0.82Total Comm. (GB)
4
CIFAR-10
93.55Accuracy (Clean)
4
CIFAR-10
0.876Accuracy
4
CIFAR-10
96.59Accuracy
4
CIFAR-10 Non-IID 0.5
61.45Accuracy
4
CIFAR-10 IID
63.9Accuracy
4
CIFAR-10 long-tailed (val)
9.38FID
4
CIFAR-10 (test)
77.12Vanilla Accuracy
4
CIFAR-10 (fine-tuning)
99.3Accuracy
4
CIFAR-10
2.46ECE (%)
4
CIFAR-100 4000 labels
78.32Accuracy
4
CIFAR-10
9.35Inception Score
4
CIFAR-100
-2.01W4A4 Error
4
CIFAR-10 (test)
75.96Test Accuracy (Avg Last 10 Epochs)
4
CIFAR-10 one-shot
87.83BadNets ACC
4
CIFAR-100 standard (test)
68.75Accuracy (Clean)
4
CIFAR-10 standard (test)
88.71Clean Accuracy
4
CIFAR-10 (test)
88.9Clean Accuracy
4
CIFAR-10 (test)
85.51F1 Score
4
CIFAR-100 ratio 0.01
45.3Accuracy
4
CIFAR-100 ratio 0.005
40.9Accuracy
4
CIFAR-10 ratio 0.02
84.1Accuracy (%)
4
CIFAR-10 ratio 0.01
78.5Accuracy
4
CIFAR-10 ratio 0.005
72.9Accuracy
4