Continual Model Merging on CLIP Task Stream 8 tasks (test)
94.3AccuracyFine-Tuned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fine-TunedBackbone=ViT-L/142026.05 | 94.3 | — | |
| Fine-TunedBackbone=ViT-B/162026.05 | 92.4 | — | |
| Fine-TunedBackbone=ViT-B/322026.05 | 90.4 | — | |
| C. Fine-TunedBackbone=ViT-L/142026.05 | 90 | — | |
| ODE-MBackbone=ViT-L/142026.05 | 87.7 | -4 | |
| OPCMBackbone=ViT-L/142026.05 | 87 | -2.6 | |
| ODE-MBackbone=ViT-B/162026.05 | 85.3 | -6.6 | |
| C. Fine-TunedBackbone=ViT-B/162026.05 | 82.9 | — | |
| C. Task ArithmeticBackbone=ViT-L/142026.05 | 82.1 | -7.1 | |
| OPCMBackbone=ViT-B/162026.05 | 81.8 | -4.8 | |
| Average (SWA)Backbone=ViT-L/142026.05 | 80 | -7.3 | |
| C. Fine-TunedBackbone=ViT-B/322026.05 | 79.8 | — | |
| ODE-MBackbone=ViT-B/322026.05 | 79.6 | -4.2 | |
| C. Task ArithmeticBackbone=ViT-B/162026.05 | 77.1 | -4.2 | |
| OPCMBackbone=ViT-B/322026.05 | 75.5 | -6.3 | |
| Average (SWA)Backbone=ViT-B/162026.05 | 72.3 | -9.7 | |
| C. Task ArithmeticBackbone=ViT-B/322026.05 | 67.5 | -9.6 | |
| C. Ties-MergingBackbone=ViT-B/162026.05 | 66.8 | -5.5 | |
| Average (SWA)Backbone=ViT-B/322026.05 | 66.3 | -11.5 | |
| Pre-TrainedBackbone=ViT-L/142026.05 | 64.9 | — | |
| C. Ties-MergingBackbone=ViT-L/142026.05 | 64.3 | -13 | |
| Pre-TrainedBackbone=ViT-B/162026.05 | 55.4 | — | |
| C. Ties-MergingBackbone=ViT-B/322026.05 | 49 | -15.3 | |
| Pre-TrainedBackbone=ViT-B/322026.05 | 48.1 | — |