CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-100 200 labels
20.06Top-1 Error Rate
6
CIFAR-100 (test)
0.919NLL
6
CIFAR-100
0.001MSE
6
CIFAR100 (test)
22.05R@1
6
CIFAR-100 10000 labeled samples
72.48Top-1 Acc
6
CIFAR-100 (2500 labeled samples)
67.09Top-1 Acc
6
CIFAR-100 400 labeled samples
53.94Top-1 Accuracy
6
CIFAR-10 4000 labeled samples
95.62Top-1 Acc
6
CIFAR-10 standard (train=4K, unlabeled=41K)
3.95Error Rate
6
CIFAR-10 FedAvg (test)
65.54Accuracy
6
CIFAR-10 (test)
1.26MAE
6
CIFAR-10 (train)
0.83MAE
6
CIFAR-10
98.3VGG-16 Robustness Score
6
CIFAR-10C Saturate
41MAE (%)
6
CIFAR-10.2 (test)
3.93MAE (%)
6
CIFAR-10.1 (test)
1.11MAE (OOD Accuracy)
6
CIFAR-10 near-distribution (test)
99.41AUROC
6
CIFAR-100+
6.43RR
6
CIFAR-10+
0.426RR
6
CIFAR100
72.12Clean Accuracy
6
CIFAR10
91.95Clean Accuracy
6
CIFAR-10 SCOOD Benchmark Average (6 OOD datasets)
8.53FPR95
6
CIFAR-10
1,372Total Regret
6
CIFAR-10 WaNet attack (test)
93.78Accuracy
6
CIFAR-10 CLB attack (test)
87.7Accuracy
6