Image Classification on SUN397, Cars, EuroSAT, GTSRB, MNIST, DTD (test)
0.8195SUN397 AccuracyTwin-Merging
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Twin-MergingBackbone=ViT-L/142025.12 | 0.8195 | 0.916 | 0.9973 | 0.9342 | 0.9959 | 0.8354 | 0.9164 | |
| T-SwitchBackbone=ViT-L/142025.12 | 0.8184 | 0.9238 | 0.9974 | 0.9908 | 0.9963 | 0.8372 | 0.9273 | |
| DTS-TBackbone=ViT-L/142025.12 | 0.8182 | 0.9193 | 0.999 | 0.9921 | 0.9977 | 0.8393 | 0.9276 | |
| DTS-D*Backbone=ViT-L/142025.12 | 0.8179 | 0.9207 | 0.9986 | 0.9922 | 0.9972 | 0.8399 | 0.9278 | |
| DTS-DBackbone=ViT-L/142025.12 | 0.8175 | 0.9209 | 0.9988 | 0.9925 | 0.9972 | 0.8415 | 0.9281 | |
| IndividualBackbone=ViT-L/142025.12 | 0.8172 | 0.9239 | 0.9988 | 0.9924 | 0.9969 | 0.8415 | 0.9285 | |
| DTS-T*Backbone=ViT-L/142025.12 | 0.8172 | 0.9224 | 0.9978 | 0.9912 | 0.9967 | 0.8385 | 0.9273 | |
| WEMOEBackbone=ViT-L/142025.12 | 0.8164 | 0.9222 | 0.9953 | 0.9914 | 0.9968 | 0.8285 | 0.9251 | |
| EMR-MergingBackbone=ViT-L/142025.12 | 0.8087 | 0.9152 | 0.9964 | 0.991 | 0.9973 | 0.8324 | 0.9235 | |
| TALL-MaskBackbone=ViT-L/142025.12 | 0.8058 | 0.9161 | 0.9976 | 0.9924 | 0.9974 | 0.8314 | 0.9234 | |
| AdaMergingBackbone=ViT-L/142025.12 | 0.7998 | 0.9034 | 0.9714 | 0.9847 | 0.993 | 0.8052 | 0.9096 | |
| SVDBackbone=ViT-L/142025.12 | 0.7849 | 0.8973 | 0.9986 | 0.9891 | 0.9971 | 0.8191 | 0.9143 | |
| RegMeanBackbone=ViT-L/142025.12 | 0.7783 | 0.8992 | 0.9853 | 0.9262 | 0.989 | 0.7871 | 0.8942 | |
| Ties-MergingBackbone=ViT-L/142025.12 | 0.7721 | 0.8837 | 0.9674 | 0.9244 | 0.9933 | 0.7463 | 0.8812 | |
| DAREBackbone=ViT-L/142025.12 | 0.7656 | 0.8445 | 0.97 | 0.9046 | 0.9958 | 0.7112 | 0.8653 | |
| Task-ArithmeticBackbone=ViT-L/142025.12 | 0.7528 | 0.857 | 0.955 | 0.8937 | 0.9891 | 0.692 | 0.8566 | |
| IndividualBackbone=ViT-B/322025.12 | 0.7449 | 0.7773 | 0.998 | 0.9873 | 0.9969 | 0.7936 | 0.883 | |
| WEMOEBackbone=ViT-B/322025.12 | 0.7432 | 0.7816 | 0.9871 | 0.9864 | 0.9957 | 0.7513 | 0.8742 | |
| DTS-TBackbone=ViT-B/322025.12 | 0.7415 | 0.7685 | 0.9966 | 0.9834 | 0.9963 | 0.7903 | 0.8794 | |
| DTS-DBackbone=ViT-B/322025.12 | 0.7415 | 0.7687 | 0.9978 | 0.9863 | 0.9967 | 0.7878 | 0.8798 | |
| DTS-T*Backbone=ViT-B/322025.12 | 0.7414 | 0.7626 | 0.997 | 0.9825 | 0.9961 | 0.7874 | 0.8778 | |
| DTS-D*Backbone=ViT-B/322025.12 | 0.7407 | 0.7662 | 0.9976 | 0.9858 | 0.9967 | 0.7883 | 0.8792 | |
| T-SwitchBackbone=ViT-B/322025.12 | 0.7405 | 0.7732 | 0.9952 | 0.9841 | 0.9956 | 0.7855 | 0.879 | |
| TALL-MaskBackbone=ViT-B/322025.12 | 0.7302 | 0.7738 | 0.9938 | 0.9846 | 0.9966 | 0.7761 | 0.8758 | |
| EMR-MergingBackbone=ViT-B/322025.12 | 0.7181 | 0.7461 | 0.9932 | 0.984 | 0.9963 | 0.7585 | 0.866 | |
| Twin-MergingBackbone=ViT-B/322025.12 | 0.7176 | 0.692 | 0.7324 | 0.9337 | 0.9964 | 0.7225 | 0.7991 | |
| SVDBackbone=ViT-B/322025.12 | 0.7118 | 0.716 | 0.9964 | 0.9802 | 0.9966 | 0.7758 | 0.8628 | |
| DAREBackbone=ViT-B/322025.12 | 0.6999 | 0.6932 | 0.7216 | 0.5539 | 0.8452 | 0.5681 | 0.6803 | |
| AdaMergingBackbone=ViT-B/322025.12 | 0.6984 | 0.7245 | 0.9518 | 0.9553 | 0.9816 | 0.7071 | 0.8365 | |
| RegMeanBackbone=ViT-B/322025.12 | 0.6945 | 0.7053 | 0.9706 | 0.8699 | 0.9835 | 0.6712 | 0.8158 | |
| Fisher-MergingBackbone=ViT-L/142025.12 | 0.6892 | 0.8861 | 0.9493 | 0.8267 | 0.9005 | 0.7241 | 0.8293 | |
| Ties-MergingBackbone=ViT-B/322025.12 | 0.6827 | 0.6593 | 0.8122 | 0.7001 | 0.8907 | 0.5602 | 0.7175 | |
| Fisher-MergingBackbone=ViT-B/322025.12 | 0.6819 | 0.6741 | 0.8647 | 0.6723 | 0.8164 | 0.5869 | 0.7161 | |
| Task-ArithmeticBackbone=ViT-B/322025.12 | 0.6528 | 0.6368 | 0.8717 | 0.7618 | 0.9424 | 0.5647 | 0.7384 |