Image Classification on 8-task Average
91.16AccuracyAuto-FlexSwitch+CKA (λ = 3)
Evaluation Results
| Method | Links | |
|---|---|---|
| Auto-FlexSwitch+CKA (λ = 3)Type=Dynamic, Storage (MB)=47.26, Backbone=ViT-B/322026.04 | 91.16 | |
| IndividualBackbone=ViT-B/322026.04 | 91.01 | |
| Auto-FlexSwitch+KL (λ = 0.3)Type=Dynamic, Storage (MB)=41.51, Backbone=ViT-B/322026.04 | 91 | |
| Auto-FlexSwitch+MSE (λ = 0.05)Type=Dynamic, Storage (MB)=50.72, Backbone=ViT-B/322026.04 | 90.94 | |
| Auto-SwitchType=Dynamic, Storage (MB)=185.28, Backbone=ViT-B/322026.04 | 90.51 | |
| Twin-MergingType=Dynamic, Storage (MB)=711.10, Backbone=ViT-B/322026.04 | 89.62 | |
| Traditional MTLBackbone=ViT-B/322026.04 | 88.78 | |
| EMR-MergingType=Dynamic, Storage (MB)=540.19, Backbone=ViT-B/322026.04 | 88.74 | |
| MoW-MergingType=Dynamic, Storage (MB)=2171.89, Backbone=ViT-B/322026.04 | 87.28 | |
| AdaMerging++Type=Static, Backbone=ViT-B/322026.04 | 80.96 | |
| AdaMergingType=Static, Backbone=ViT-B/322026.04 | 79.96 | |
| RegMeanType=Static, Backbone=ViT-B/322026.04 | 79.86 | |
| Ties-MergingType=Static, Backbone=ViT-B/322026.04 | 73.66 | |
| DF-MergeType=Static, Backbone=ViT-B/322026.04 | 73.48 | |
| DAREType=Static, Backbone=ViT-B/322026.04 | 70.27 | |
| Task-ArithmeticType=Static, Backbone=ViT-B/322026.04 | 70.23 | |
| Fisher MergingType=Static, Backbone=ViT-B/322026.04 | 69.65 | |
| Weight-AveragingType=Static, Backbone=ViT-B/322026.04 | 65.85 | |
| Pre-trainedBackbone=ViT-B/322026.04 | 48.1 |