ImageNet
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ImageNet 128x128 (train test)
0.24TFLOPs
13
ImageNet-1k 50 Tasks (test)
42.8Accuracy
13
ImageNet-1k 20 Tasks (test)
52.1Accuracy
13
ImageNet-1k 10 Tasks (test)
59.4Accuracy
13
ImageNet-1k 50 Tasks (test)
25.6Accuracy
13
ImageNet-1k 20 Tasks (test)
34.2Accuracy
13
ImageNet-1k 10 Tasks (test)
41.3Accuracy
13
ImageNet 256 x 256 (val)
28.885PSNR
13
Tiny-ImageNet 3-class forgetting
0.03Time
13
ImageNet Generalized
74.63Harmonic Mean
13
ImageNet (Novel Split)
72.06Accuracy
13
ImageNet (Base)
78.05Accuracy
13
ImageNet-1k Far-OOD (val)
24.77FPR@95
13
ImageNet-1k Near-OOD (val)
65.23FPR@95
13
ImageNet-to-ImageNet-C Average (severity 5)
62Accuracy
13
ImageNet-to-ImageNet-C severity=5, κ=0.1 (test)
61.7Places-C Accuracy
13
ImageNet-to-ImageNet OOD suite (Places-C, Texture-C, iNatur-C, SUN-C, SSB-H-C, NINCO-C) C (test)
62.4ACC (Places-C)
13
ImageNet-to-ImageNet-C severity=5, κ=0.3 (test)
61.4Accuracy (Places-C)
13
ImageNet 256 x 256
24.65PSNR
13
ImageNet-Compatible (test)
83Overall Success Rate
13
ImageNet 1-class unlearning 1K
39.18PGH
13
ImageNet
77.95Base Accuracy
13
S-ImageNet-1K 100 tasks 1.0 (test)
38.75Training Time (Hours)
13
ImageNet (random sampling)
79.04Utility Retention (Au)
13
ImageNet Random Sampling 3-seed average (train)
94.54Au Score
13