Image Classification on MNIST (accuracy, performance gain)
99.8Accuracyfine-tuned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| fine-tunedBackbone=ViT-L/142026.02 | 99.8 | — | |
| fine-tunedBackbone=ViT-B/162026.02 | 99.7 | — | |
| fine-tunedBackbone=ViT-B/322026.02 | 99.6 | — | |
| ISO-C/LARVBackbone=ViT-L/142026.02 | 99.2 | 0.1 | |
| ISO-CTS/LARVBackbone=ViT-L/142026.02 | 99.2 | 0.1 | |
| TSV-M/LARVBackbone=ViT-L/142026.02 | 99.2 | 0.1 | |
| TSV-M/LARVBackbone=ViT-B/162026.02 | 99.1 | 0 | |
| TSV-M/LARVBackbone=ViT-B/322026.02 | 98.9 | 0 | |
| ISO-CTS/LARVBackbone=ViT-B/162026.02 | 98.9 | 0.3 | |
| ISO-C/LARVBackbone=ViT-B/322026.02 | 98.8 | 0.3 | |
| ISO-C/LARVBackbone=ViT-B/162026.02 | 98.8 | -0.1 | |
| TA/LARVBackbone=ViT-B/162026.02 | 98.6 | 0.5 | |
| TA/LARVBackbone=ViT-L/142026.02 | 98.6 | 0.6 | |
| ISO-CTS/LARVBackbone=ViT-B/322026.02 | 98.3 | 0.2 | |
| TIES/LARVBackbone=ViT-B/162026.02 | 98.3 | 1.9 | |
| TIES/LARVBackbone=ViT-L/142026.02 | 98.2 | 0.4 | |
| TA/LARVBackbone=ViT-B/322026.02 | 97.3 | 1.2 | |
| Simple AveragingBackbone=ViT-L/142026.02 | 96.6 | — | |
| AdaMergingBackbone=ViT-B/162026.02 | 96.4 | — | |
| TIES/LARVBackbone=ViT-B/322026.02 | 95.4 | 1.3 | |
| Simple AveragingBackbone=ViT-B/162026.02 | 93.8 | — | |
| AdaMergingBackbone=ViT-L/142026.02 | 93.1 | — | |
| Simple AveragingBackbone=ViT-B/322026.02 | 86.3 | — |