tinyimagenet
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TinyImageNet-C (test)
89.96Coverage
14
S-TinyImageNet (test)
53.7Average Accuracy
14
Split-TinyImageNet M = 5k (test)
62.21Accuracy
13
TinyImageNet 20 steps 100 base classes (test)
79.32Average Accuracy
13
TinyImageNet 5 steps 100 base classes (test)
81.16Avg Score
13
Seq-TinyImageNet (test)
82.04Top-1 Accuracy
13
Seq-TinyImageNet (test)
59.99Top-1 Acc (Avg)
13
TinyImageNet 20 Steps (test)
86.39Average Accuracy
12
TinyImageNet-200
77AIA Top-1 Accuracy
12
TinyImageNet
9.08Avg Forgetting
12
TinyImageNet scale-up (Heterogeneous)
37.54FAA
11
TinyImageNet scale-up (Homogeneous)
40.36FAA
11
TinyImageNet Practical Label Skew Dirichlet (test)
25.15Accuracy
11
TinyImageNet Pathological Label Skew (test)
29.3Accuracy
11
TinyImageNet (test)
22.17FPR95
11
TinyImageNet-C (test)
37.26Accuracy (C)
11
TinyImageNet class-wise forgetting (test)
100Unlearning Accuracy (UA)
10
TinyImageNet VNN-Comp'24 model
18Certified Accuracy (%)
10
TinyImageNet T=20 (test)
31.3Alast
10
TinyImageNet 35 (test)
70Accuracy (10 classes)
10
TinyImageNet first 10 tasks 35
70Performance @ 10%
10
TinyImageNet NID2 label quantity skew
40.52Accuracy
9
TinyImageNet NID1_0.5 label/quantity skew
46.9Accuracy
9
TinyImageNet Long-tail NID10.5 (test)
37.72Accuracy (rho=10)
9
TinyImageNet NID1, α=0.5
46.9Accuracy
9