Outside Knowledge Visual Question Answering on AOKVQA
86.17AUCReLope
Evaluation Results
| Method | Links | |
|---|---|---|
| ReLopeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 86.17 | |
| ReLopeBackbone=Phi-4-Multimodal-Instruct2026.03 | 85.9 | |
| ReLopeBackbone=Gemma3-12B2026.03 | 85.73 | |
| Attention ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 84.34 | |
| ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 82.03 | |
| Attention ProbeBackbone=Phi-4-Multimodal-Instruct2026.03 | 80.27 | |
| ProbeBackbone=Phi-4-Multimodal-Instruct2026.03 | 76.23 | |
| ProbeBackbone=Gemma3-12B2026.03 | 75.13 | |
| Attention ProbeBackbone=Gemma3-12B2026.03 | 74.58 | |
| Cascade RoutingBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 73.15 | |
| Post-Hoc EmbedBackbone=Phi-4-Multimodal-Instruct2026.03 | 72.66 | |
| MoTBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 72.35 | |
| Post-Hoc EmbedBackbone=Gemma3-12B2026.03 | 71.92 | |
| RouteLLMBackbone=Phi-4-Multimodal-Instruct2026.03 | 70.81 | |
| Cascade RoutingBackbone=Phi-4-Multimodal-Instruct2026.03 | 70.04 | |
| Post-Hoc EmbedBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 69.92 | |
| RouteLLMBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 68.51 | |
| MoTBackbone=Phi-4-Multimodal-Instruct2026.03 | 68.42 | |
| MoTBackbone=Gemma3-12B2026.03 | 68.05 | |
| RouteLLMBackbone=Gemma3-12B2026.03 | 66.1 | |
| Cascade RoutingBackbone=Gemma3-12B2026.03 | 64.91 |