Multimodal Concept Understanding on MCUB 3
59.4I+V+P+L ScoreSSAM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SSAMMethod Type=Training-free model merging methods2026.03 | 59.4 | 61 | 65.4 | 55.6 | 60.35 | |
| DAMCMethod Type=Training-free model merging methods2026.03 | 58.2 | 58.8 | 65.6 | 56.6 | 59.8 | |
| NaiveMCMethod Type=Training-free model merging methods2026.03 | 53 | 51 | 58.8 | 56 | 54.7 | |
| OptMergeMethod Type=Training-free model merging methods2026.03 | 52.8 | 53.6 | 58.6 | 53.8 | 54.7 | |
| TSVMethod Type=Training-free model merging methods2026.03 | 48 | 48 | 58 | 51.6 | 51.4 | |
| Proj-OnlyMethod Type=Models finetuned on paired multimodal data2026.03 | 42.6 | 43.8 | 42.8 | 47.4 | 44.15 | |
| WUDIMethod Type=Training-free model merging methods2026.03 | 38.2 | 40.4 | 44.4 | 44.4 | 41.85 | |
| Task ArithmeticMethod Type=Training-free model merging methods2026.03 | 36.8 | 37.6 | 43.8 | 45 | 40.8 | |
| ImageBind-LLMMethod Type=Models finetuned on paired multimodal data2026.03 | 31.8 | 31.4 | 33.4 | 35.2 | 32.95 | |
| X-InstructBLIPMethod Type=Models finetuned on paired multimodal data2026.03 | 29.4 | 25.2 | 21.2 | 41.4 | 29.3 |