Yes/No Question Answering on Reefknot
45.31AccuracyVanilla
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| VanillaMLLM Model=InstructBLIP2026.04 | 45.31 | 42.47 | 55.94 | |
| VCDMLLM Model=InstructBLIP2026.04 | 45.22 | 42.35 | 56.05 | |
| DecoMLLM Model=InstructBLIP2026.04 | 45.17 | 42.21 | 56.14 | |
| OPERAMLLM Model=InstructBLIP2026.04 | 45.03 | 42.05 | 56.28 | |
| PAIMLLM Model=InstructBLIP2026.04 | 44.89 | 41.86 | 56.45 | |
| VASparseMLLM Model=InstructBLIP2026.04 | 44.67 | 42.47 | 56.3 | |
| MemVRMLLM Model=InstructBLIP2026.04 | 44.34 | 42.09 | 56.65 | |
| IVEMLLM Model=InstructBLIP2026.04 | 43.75 | 40.6 | 57.64 | |
| VanillaMLLM Model=LLaVA-1.52026.04 | 37.67 | 33.99 | 63.96 | |
| VCDMLLM Model=LLaVA-1.52026.04 | 37.33 | 33.67 | 64.58 | |
| DecoMLLM Model=LLaVA-1.52026.04 | 37.22 | 33.42 | 64.51 | |
| VanillaMLLM Model=Qwen2.5-VL-Instruct2026.04 | 37.22 | 20.58 | 70.12 | |
| PAIMLLM Model=LLaVA-1.52026.04 | 37.21 | 33.77 | 64.31 | |
| VASparseMLLM Model=LLaVA-1.52026.04 | 37.13 | 33.14 | 64.63 | |
| VCDMLLM Model=Qwen2.5-VL-Instruct2026.04 | 37.13 | 20.47 | 70.23 | |
| OPERAMLLM Model=LLaVA-1.52026.04 | 37.08 | 33.23 | 64.62 | |
| DecoMLLM Model=Qwen2.5-VL-Instruct2026.04 | 37 | 20.33 | 70.36 | |
| MemVRMLLM Model=LLaVA-1.52026.04 | 36.99 | 32.81 | 64.86 | |
| VASparseMLLM Model=Qwen2.5-VL-Instruct2026.04 | 36.91 | 20.86 | 70.17 | |
| OPERAMLLM Model=Qwen2.5-VL-Instruct2026.04 | 36.86 | 20.12 | 70.53 | |
| PAIMLLM Model=Qwen2.5-VL-Instruct2026.04 | 36.82 | 19.95 | 70.63 | |
| MemVRMLLM Model=Qwen2.5-VL-Instruct2026.04 | 36.75 | 20.16 | 70.57 | |
| IVEMLLM Model=Qwen2.5-VL-Instruct2026.04 | 35.97 | 18.93 | 71.55 | |
| IVEMLLM Model=LLaVA-1.52026.04 | 35.88 | 32.07 | 65.8 |