CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR10 pair noise 0.1 Dirichlet non-IID (a=100) (test)
0.28ECE
11
CIFAR-10 50% seen 50% novel
94.9Seen Accuracy
11
CIFAR-100 (test)
77.5Accuracy (Session 1)
11
CIFAR-10 L2, epsilon=8/255
77.64Robust Acc (AA)
11
CIFAR-10 (test)
96.52Accuracy (0% Noise)
11
CIFAR-FS 1-shot
77.02Accuracy
11
CIFAR-10 (test)
0.972AUCPR
11
Inst. CIFAR100 (test)
69.11Accuracy (eta=0.2)
11
CIFAR-100 clean (test)
72.91Accuracy (ε=0.2)
11
CIFAR-10 Unconditional
2.8NLL (bits/dim)
11
CIFAR-LT-100 Imbalance ratio 10 (test)
58.2BACC
11
CIFAR-LT-100 Imbalance ratio 100 (test)
0.435BACC
11
CIFAR-LT Imbalance ratio 10 (test)
87.9BACC
11
CIFAR-100 (val)
71.3Accuracy (40% noise)
11
CIFAR-10 (test)
93.61Accuracy (r=0.1)
11
CIFAR-10 Gaussian
100AUROC
11
CIFAR
16.75Error Rate (%)
11
CIFAR-10 (test)
100Success Rate
11
CIFAR-10 noise padded
59Accuracy
11
CIFAR10 6 known and 4 unknown classes
97.3AUROC
10
CIFAR-100 Dirichlet alpha=0.1 (test)
40.16Test Accuracy
10
CIFAR-100 Dirichlet alpha=0.6 (test)
45.99Test Accuracy
10
CIFAR-10 Dirichlet alpha=0.1 (test)
78.05Test Accuracy
10
CIFAR-10 Dirichlet alpha=0.6 (test)
85.11Test Accuracy
10
CIFAR-100 (test)
49.36Test Accuracy
10