Image Classification on ImageNet-C (level 1, test)
81.6Brightness AccuracyAPM
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| APMleveraged pre-trained weights & downstream-ttt=false2024.10 | 81.6 | 80.3 | 78.6 | 78 | 78.6 | 76.6 | 77.2 | 75.7 | 75.1 | 79.6 | 78.7 | 79.1 | 76.9 | 76.4 | 70.7 | 76 | |
| TTT-MAEleveraged pre-trained weights & downstream-ttt=true2024.10 | 78.9 | 74.7 | 72.5 | 74.7 | 72.9 | 72.2 | 76.8 | 72.2 | 75.5 | 74.5 | 75.8 | 77 | 75.9 | 71.9 | 69.3 | 73.1 | |
| TTT-MAEsteps of TTT=102022.09 | 78.9 | 74.7 | 72.5 | 74.7 | 72.9 | 72.2 | 76.8 | 72.2 | 75.5 | 74.5 | 75.8 | 77 | 75.9 | 71.9 | 69.3 | — | |
| Baselineleveraged pre-trained weights & downstream-ttt=true2024.10 | 78.5 | 74.5 | 68.1 | 73.9 | 70.5 | 70.6 | 74.8 | 68.6 | 72.3 | 73 | 75.2 | 75.9 | 73.6 | 69.3 | 63.7 | 71.4 | |
| Baselinesteps of TTT=102022.09 | 78.5 | 74.5 | 68.1 | 73.9 | 70.5 | 70.6 | 74.8 | 68.6 | 72.3 | 73 | 75.2 | 75.9 | 73.6 | 69.3 | 63.7 | — | |
| OpenCLIP VIT-L/14leveraged pre-trained weights & downstream-ttt=false2024.10 | 77.3 | 75.4 | 73.5 | 73.1 | 73.5 | 71.4 | 71.9 | 70.2 | 69.9 | 75.1 | 73.7 | 74.2 | 71.9 | 71.2 | 65.2 | 71.1 |