SVHN
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SVHN [0:4] (ID) vs [5:9] (OOD) (test)
0.96AUROC
10
SVHN PGDL (train test)
45.61CMI
10
SVHN (test)
93AUROC (%)
10
SVHN CIFAR100 OOD (train)
0.47FPR
10
SVHN CIFAR10 OOD (train)
45FPR
10
SVHN-LT gamma=100, beta=20% (test)
93.8G-mean
10
SVHN (unlabelled set)
95.2Accuracy
10
SVHN
100Retention Accuracy (RA)
9
SVHN
97.3AUROC vs C10
9
SVHN OOD
78.19AUROC
9
SVHN ID (test)
1.28ECE
9
SVHN
45.61OOD Score (CIFAR-10)
9
SVHN
80.31Acc (alpha=0.1)
9
SVHN IDN-50% (test)
85.41Accuracy
9
SVHN IDN-45% (test)
93.19Accuracy
9
SVHN IDN-40% (test)
93.82Accuracy
9
SVHN IDN-30% (test)
93.86Accuracy
9
SVHN IDN-20% (test)
94.08Accuracy
9
SVHN 40 labels (test)
3.81Error Rate
9
SVHN (test)
1Rounds
8
SVHN (test)
2.93Log-Likelihood
8
SVHN class-fraction-to-forget = 0.5 (partial deletion of digit 9)
100Utility Accuracy (UA)
8
SVHN-LT (rho=1)
43.48FID
8
SVHN-LT (rho=10)
42.01FID
8
SVHN-LT rho=50
42.6FID
8