Multiple Choice Question Answering on Reefknot
74.05Perc. ScorePAI
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PAIMLLM Model=InstructBLIP2026.04 | 74.05 | 53.83 | 39.91 | |
| VanillaMLLM Model=InstructBLIP2026.04 | 73.91 | 53.85 | 39.94 | |
| VASparseMLLM Model=InstructBLIP2026.04 | 73.91 | 53.48 | 40.2 | |
| VCDMLLM Model=InstructBLIP2026.04 | 73.67 | 53.75 | 40.09 | |
| MemVRMLLM Model=InstructBLIP2026.04 | 73.4 | 53.19 | 40.56 | |
| DecoMLLM Model=InstructBLIP2026.04 | 73.3 | 53.6 | 40.3 | |
| OPERAMLLM Model=InstructBLIP2026.04 | 72.98 | 53.23 | 40.66 | |
| IVEMLLM Model=InstructBLIP2026.04 | 72.09 | 52.19 | 41.66 | |
| VanillaMLLM Model=LLaVA-1.52026.04 | 68.05 | 51.04 | 43.7 | |
| VCDMLLM Model=LLaVA-1.52026.04 | 67.86 | 50.9 | 43.86 | |
| PAIMLLM Model=Qwen2.5-VL-Instruct2026.04 | 67.58 | 49.25 | 45.08 | |
| DecoMLLM Model=LLaVA-1.52026.04 | 67.54 | 50.73 | 44.07 | |
| VASparseMLLM Model=LLaVA-1.52026.04 | 67.21 | 50.88 | 44.13 | |
| VanillaMLLM Model=Qwen2.5-VL-Instruct2026.04 | 67.16 | 49.69 | 44.91 | |
| OPERAMLLM Model=LLaVA-1.52026.04 | 67.12 | 50.21 | 44.56 | |
| VCDMLLM Model=Qwen2.5-VL-Instruct2026.04 | 67.02 | 49.58 | 45.02 | |
| MemVRMLLM Model=LLaVA-1.52026.04 | 66.98 | 50.79 | 44.2 | |
| PAIMLLM Model=LLaVA-1.52026.04 | 66.93 | 51.1 | 44 | |
| DecoMLLM Model=Qwen2.5-VL-Instruct2026.04 | 66.84 | 49.38 | 45.22 | |
| OPERAMLLM Model=Qwen2.5-VL-Instruct2026.04 | 66.51 | 49.13 | 45.5 | |
| VASparseMLLM Model=Qwen2.5-VL-Instruct2026.04 | 66.51 | 49.21 | 45.44 | |
| MemVRMLLM Model=Qwen2.5-VL-Instruct2026.04 | 66.37 | 49.15 | 45.53 | |
| IVEMLLM Model=LLaVA-1.52026.04 | 66.19 | 50 | 45 | |
| IVEMLLM Model=Qwen2.5-VL-Instruct2026.04 | 65.72 | 48.33 | 46.29 |