Image Classification on SVHN (Accuracy)
98.12AccuracyIndividual
Evaluation Results
| Method | Links | |
|---|---|---|
| IndividualBackbone=ViT-L/142026.04 | 98.12 | |
| Auto-SwitchType=Dynamic, Storage (MB)=556.88, Backbone=ViT-L/142026.04 | 98.12 | |
| Twin-MergingType=Dynamic, Storage (MB)=1780.62, Backbone=ViT-L/142026.04 | 98.06 | |
| MoW-MergingType=Dynamic, Storage (MB)=5159.51, Backbone=ViT-L/142026.04 | 98.06 | |
| Auto-FlexSwitch+MSE (λ = 0.05)Type=Dynamic, Storage (MB)=98.41, Backbone=ViT-L/142026.04 | 98.04 | |
| Auto-FlexSwitch+KL (λ = 0.3)Type=Dynamic, Storage (MB)=80.69, Backbone=ViT-L/142026.04 | 98.02 | |
| EMR-MergingType=Dynamic, Storage (MB)=1633.46, Backbone=ViT-L/142026.04 | 97.94 | |
| Auto-FlexSwitch+CKA (λ = 3)Type=Dynamic, Storage (MB)=89.76, Backbone=ViT-L/142026.04 | 97.84 | |
| Traditional MTLBackbone=ViT-L/142026.04 | 97.79 | |
| Fine-TunedBackbone=DINOv3 ViT-B/162025.12 | 97 | |
| AdaMerging++Type=Static, Backbone=ViT-L/142026.04 | 92.76 | |
| RegMeanType=Static, Backbone=ViT-L/142026.04 | 92.6 | |
| AdaMergingType=Static, Backbone=ViT-L/142026.04 | 91.79 | |
| DAREType=Static, Backbone=ViT-L/142026.04 | 89.19 | |
| Task-ArithmeticType=Static, Backbone=ViT-L/142026.04 | 87.91 | |
| DF-MergeType=Static, Backbone=ViT-L/142026.04 | 87.09 | |
| Ties-MergingType=Static, Backbone=ViT-L/142026.04 | 86.53 | |
| Fisher MergingType=Static, Backbone=ViT-L/142026.04 | 83.36 | |
| Weight-AveragingType=Static, Backbone=ViT-L/142026.04 | 78.23 | |
| Linear ProbeBackbone=DINOv3 ViT-B/162025.12 | 66.9 | |
| Task MatrixBackbone=DINOv3 ViT-B/16, best layer=82025.12 | 63.1 | |
| Pre-trainedBackbone=ViT-L/142026.04 | 58.43 |