ImageNet-R
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ImageNet-R B0 Inc5 (test)
82.44Average Accuracy
13
ImageNet-R Inc5 (test)
72.52Average Accuracy
13
ImageNet-R
75.23FAA (β=0.5)
13
ImageNet-R 5-task (test)
49.34Average Accuracy (AA)
12
ImageNet-R (test)
88.84AUROC
11
ImageNet-R 50-task partition
82.06FAA
10
ImageNet-R 50 tasks
74.85Accuracy (Last Task)
10
ImageNet-R TI2I modified
32CLIP Similarity
10
ImageNet-R Full set
66.75Top-1 Acc
10
ImageNet-R T=10
75.78Accuracy
9
ImageNet-R B100 Inc10 (test)
84.77Average Accuracy
9
ImageNet-R B0 Inc40 (test)
87.57Average Accuracy
9
ImageNet-R (20-Split)
74.73Accuracy
9
ImageNet-R (5-Split)
79.88Accuracy
9
ImageNet-R 100 tasks
70.72Accuracy
9
ImageNet-R 5 tasks
81.14ACC_5
9
ImageNet-R Split
72.28ACC
8
ImageNet-R 10-way 5-shot (test)
84.6Accuracy (Session 0)
8
ImageNet-R-TI2I Sketch (test)
0.194Self-Sim
8
ImageNet-R 10-Tasks Scenario
43.82Average Accuracy (AA)
7
ImageNet-R 5-Tasks Scenario
49.34Average Accuracy (AA)
7
ImageNet-R Inc-10 B-0 (test)
7.73Favg
7
ImageNet-R 10 steps (incremental)
83.48Average Accuracy
7
ImageNet-R Split (test)
0.766FAA
7
ImageNet-R Sequential (test)
82.41Last Top-1 Accuracy
7