CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 (test)
51.143Adaptive Steer
9
CIFAR-10 i.i.d.
0.96SSIM
9
CIFAR-100 N=20
53.1Accuracy
9
CIFAR-100 N=10
67.9Accuracy
9
CIFAR-100
63.6Clean Accuracy
9
CIFAR-10
92.7Clean Accuracy
9
CIFAR-100 (test)
82.3Rejection Accuracy @ 90%
9
CIFAR-10 standard
101Rounds (Acc 20%)
9
CIFAR-10 (test)
30.16Accuracy
9
CIFAR-10
76.2AMI
9
CIFAR-10 Dir(0.01), 10 clients, full participation
75.49Accuracy (4bit SQ)
9
CIFAR-10 Path(1), 10 clients, full participation
71.56Accuracy (SQ 4bit)
9
CIFAR-10 SCOOD (test)
13.06FPR@95
9
Cifar100
60.47Clean Accuracy
9
CIFAR10
88.2AUROC
9
CIFAR-100 (test)
74.02Baseline Accuracy
9
CIFAR-100 ID (test)
6.08ECE
9
CIFAR-10 ID (test)
1.88ECE
9
CIFAR-100
86.46SVHN Score
9
CIFAR-10 Airplane, Ship, Bird average
98.14Accuracy (e)
9
CIFAR-10 Ship class
98.64Accuracy (E)
9
CIFAR-100-C
43FPR95 (Contrast)
9
CIFAR-10 In-Distribution (test)
0.51FPR95 (SVHN)
9
CIFAR-100 original (test)
2.9SVHN FPR95
9
CIFAR-100 (test)
100Top-1 ASR
9