CIFAR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CIFAR-10 (test)
—Runtime (WAN)
0
CIFAR-10 (test)
—Primary metric
0
CIFAR-10
—Primary metric
0
CIFAR-10
—Rounds to 70% Acc
0
CIFAR-100
—Primary metric
0
CIFAR-10
—Primary metric
0
CIFAR10 (test)
—Natural Accuracy
0
CIFAR100 (test)
—Natural Accuracy
0
CIFAR100 (test)
—Average Accuracy
0
CIFAR-10 (test)
—Primary metric
0
CIFAR-100 Dirichlet 0.3 (test)
—Accuracy (500R)
0
CIFAR-100 (test)
—Acc @ 500R
0
CIFAR-10 (test)
—Accuracy @ 500R
0
CIFAR-100 500 clients Dirichlet 0.3
—Accuracy (R500)
0
CIFAR-10 Dirichlet 0.3 (500 clients)
—Accuracy (Round 500)
0
CIFAR-10 DARTS search space (val)
—Primary metric
0
CIFAR10 (test)
—Communication Rounds (Acc=75%)
0
CIFAR100 (test)
—Primary metric
0
CIFAR10 (test)
—Primary metric
0
CIFAR
—Primary metric
0
CIFAR-10
—PGD Robustness
0
CIFAR10
—Accuracy
0
CIFAR-10 fixed subset of 512 randomly sampled images (test)
—Standard Accuracy
0
CIFAR100 (test)
—Standard Accuracy
0
CIFAR10 (test)
—Clean Accuracy
0