ImageNet-R
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ImageNet-R-TI2I HED (test)
0.153Self-Sim
7
Split ImageNet-R 10-Tasks
75.1FAA
6
ImageNet-R 10-task (test)
27.92Average Accuracy (AA)
6
ImageNet-R 50 Task (test)
43.4Average Task Accuracy (AAT)
6
ImageNet-R 50 tasks (test)
74.64Accuracy
6
Split ImageNet-R 20-task
80.27Last Task Accuracy
6
ImageNet-R (test)
19.49Insertion Score
6
ImageNet-R 10 sessions, 20-way
83.12Task Accuracy (AT)
5
ImageNet-R v1 (test)
87.8Accuracy
5
ImageNet-R (test)
99.5ROC-AUC
5
ImageNet-R
86.1EoE
5
ImageNet-R ID Four-OOD (average)
99.62AUROC
4
ImageNet-R 100 tasks
75.69Accuracy
4
ImageNet-R base classes
85.28Accuracy
4
IMAGENET-R zero-shot
90.91Accuracy
4
ImageNet-R original (val)
45.3Top-1 Acc
4
ImageNet-R (test)
140.52Communication Cost (MB)
3
ImageNet-R T=20
85.28Last-Task Accuracy
3
ImageNet-R v1 (val)
—Accuracy
0