Multimodal Relation Reasoning on MMRel
75.21AccuracyChainMPQ
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChainMPQModel=InternVL3.52025.10 | 75.21 | 72.54 | 78.65 | |
| CalibrateModel=InternVL3.52025.10 | 74.45 | 71.46 | 78.64 | |
| ChainMPQModel=Qwen2.5-VL2025.10 | 73.52 | 69.65 | 77.45 | |
| PromptingModel=InternVL3.52025.10 | 73.01 | 67.65 | 77.12 | |
| CoTModel=InternVL3.52025.10 | 72.1 | 68.74 | 76.35 | |
| VanillaModel=InternVL3.52025.10 | 71.44 | 67.07 | 75.86 | |
| CalibrateModel=Qwen2.5-VL2025.10 | 71.36 | 67.2 | 76.28 | |
| PromptingModel=Qwen2.5-VL2025.10 | 70.01 | 68.59 | 75.23 | |
| CoTModel=Qwen2.5-VL2025.10 | 67.35 | 65.49 | 72.08 | |
| VanillaModel=Qwen2.5-VL2025.10 | 66.1 | 63.07 | 72.14 | |
| ChainMPQModel=LLaVA-1.52025.10 | 65.2 | 64.75 | 71.21 | |
| ChainMPQModel=InstructBLIP2025.10 | 65.14 | 64.12 | 74.12 | |
| PromptingModel=InstructBLIP2025.10 | 64.52 | 62.28 | 71.23 | |
| CalibrateModel=LLaVA-1.52025.10 | 63.5 | 60.79 | 70.54 | |
| PromptingModel=LLaVA-1.52025.10 | 62.33 | 60.58 | 68.07 | |
| CalibrateModel=InstructBLIP2025.10 | 62.05 | 61.02 | 69.85 | |
| CoTModel=LLaVA-1.52025.10 | 61.88 | 59.14 | 66.25 | |
| CoTModel=InstructBLIP2025.10 | 59.9 | 57.12 | 65.41 | |
| VanillaModel=LLaVA-1.52025.10 | 59.02 | 56.81 | 66.4 | |
| VanillaModel=InstructBLIP2025.10 | 57.58 | 55.32 | 66.79 |