Continual Model Merging on sequence 8-task
94.3AccuracyFine-Tuned
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Fine-TunedBackbone=ViT-L/142026.04 | 94.3 | — | |
| MADE-ITBackbone=ViT-L/142026.04 | 93.1 | -0.6 | |
| Fine-TunedBackbone=ViT-B/162026.04 | 92.4 | — | |
| MINGLEBackbone=ViT-L/142026.04 | 91.8 | -0.6 | |
| Fine-TunedBackbone=ViT-B/322026.04 | 90.4 | — | |
| MADE-ITBackbone=ViT-B/162026.04 | 90.4 | -1.2 | |
| Continual Fine-TunedBackbone=ViT-L/142026.04 | 90 | — | |
| MINGLEBackbone=ViT-B/162026.04 | 88.3 | -0.4 | |
| MADE-ITBackbone=ViT-B/322026.04 | 87.1 | -2.2 | |
| OPCMBackbone=ViT-L/142026.04 | 87 | -2.6 | |
| MINGLEBackbone=ViT-B/322026.04 | 85.8 | -0.6 | |
| Continual Fine-TunedBackbone=ViT-B/162026.04 | 82.9 | — | |
| Continual Task ArithmeticBackbone=ViT-L/142026.04 | 82.1 | -7.1 | |
| OPCMBackbone=ViT-B/162026.04 | 81.8 | -4.8 | |
| Average (SWA)Backbone=ViT-L/142026.04 | 80 | -7.3 | |
| Continual Fine-TunedBackbone=ViT-B/322026.04 | 79.8 | — | |
| Continual Task ArithmeticBackbone=ViT-B/162026.04 | 77.1 | -4.2 | |
| Continual LoRA-WEMoEBackbone=ViT-L/142026.04 | 75.6 | -17.8 | |
| OPCMBackbone=ViT-B/322026.04 | 75.5 | -6.3 | |
| Continual LoRA-WEMoEBackbone=ViT-B/162026.04 | 72.6 | -18 | |
| Average (SWA)Backbone=ViT-B/162026.04 | 72.3 | -9.7 | |
| Continual LoRA-WEMoEBackbone=ViT-B/322026.04 | 68.8 | -20.4 | |
| Continual LW AdaMergingBackbone=ViT-L/142026.04 | 68.8 | -24.3 | |
| Continual Task ArithmeticBackbone=ViT-B/322026.04 | 67.5 | -9.6 | |
| Continual Ties-MergingBackbone=ViT-B/162026.04 | 66.8 | -5.5 | |
| Average (SWA)Backbone=ViT-B/322026.04 | 66.3 | -11.5 | |
| Pre-TrainedBackbone=ViT-L/142026.04 | 64.9 | — | |
| Continual Ties-MergingBackbone=ViT-L/142026.04 | 64.3 | -13 | |
| Continual LW AdaMergingBackbone=ViT-B/162026.04 | 59.9 | -27.8 | |
| Pre-TrainedBackbone=ViT-B/162026.04 | 55.4 | — | |
| Continual LW AdaMergingBackbone=ViT-B/322026.04 | 53.4 | -32.5 | |
| Continual Ties-MergingBackbone=ViT-B/322026.04 | 49 | -15.3 | |
| Pre-TrainedBackbone=ViT-B/322026.04 | 48.1 | — |