Multimodal Capability Understanding on MCUB
56.48AVI-TMMER
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MMERMethod Type=Training-free Model Merging2025.05 | 56.48 | 59.31 | 65.59 | 56 | 61.63 | |
| PCB-MergingMethod Type=Training-free Model Merging2025.05 | 54.54 | 56.68 | 63.97 | 55.6 | 60.48 | |
| TAMethod Type=Training-free Model Merging, DARE=true2025.05 | 54.25 | 56.48 | 64.17 | 55.4 | 60.08 | |
| TIESMethod Type=Training-free Model Merging, DARE=true2025.05 | 54.25 | 55.87 | 62.55 | 55.2 | 59.06 | |
| NaiveMCMethod Type=Training-free Model Merging2025.05 | 53.64 | 56.28 | 60.53 | 54.6 | 59.16 | |
| TIESMethod Type=Training-free Model Merging2025.05 | 53.64 | 55.47 | 61.74 | 54.6 | 58.55 | |
| NaiveMCMethod Type=Training-free Model Merging, DARE=true2025.05 | 53.64 | 56.68 | 60.73 | 54.8 | 59.53 | |
| TAMethod Type=Training-free Model Merging2025.05 | 53.44 | 56.28 | 63.36 | 55.4 | 59.72 | |
| X-InstructBLIPMethod Type=Training-based Multimodal Baseline2025.05 | 41.4 | 25.2 | 21.2 | 29.4 | 27.94 | |
| ImageBind-LLMMethod Type=Training-based Multimodal Baseline2025.05 | 35.2 | 31.4 | 33.4 | 31.8 | 32.93 |