NATS-Bench
Benchmarks
TaskDatasetSOTA resultTrendResults
NATS-Bench CIFAR-100 TSS (test)
73.51Accuracy
8
NATS-Bench CIFAR-10 TSS (test)
94.36Accuracy
8
NATS-Bench ImageNet16-120 (test)
45.37Accuracy
4
NATS-Bench ImageNet16-120 (val)
38.12Accuracy
4
NATS-Bench Cifar100 (test)
70.64Accuracy
4
NATS-Bench Cifar100 (val)
0.607Accuracy
4
NATS-Bench Cifar10 (test)
93.2Accuracy
4
NATS-Bench Cifar10 (val)
84.4Accuracy
4
NATS-Bench SS
0.59Kendall Tau (τ)
2
NATS-Bench ImageNet-16-120 1.0 (test)
42.03Top-1 Accuracy
2
NATS-Bench ImageNet-16-120 1.0 (val)
41.47Accuracy
2
NATS-Bench CIFAR-100 1.0 (test)
69.41Accuracy
2
NATS-Bench CIFAR-100 1.0 (val)
69.29Accuracy
2
NATS-Bench CIFAR-10 1.0 (test)
93.44Accuracy
2
NATS-Bench CIFAR-10 1.0 (val)
90.01Accuracy
2
NATS-Bench-SSS ImageNet-16-120 (test)
0.81Spearman Rho
2
NATS-Bench SSS CIFAR-100 (test)
0.74Spearman Correlation
2
NATS-Bench-SSS CIFAR-10 (test)
0.89Spearman Rho
2