List your company
ResearchFormerly WizWand

Outside Knowledge Visual Question Answering on AOKVQA

86.17AUCReLope
64.059669.799875.5481.2802Mar 25, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ReLopeBackbone=Qwen2.5-VL-7B-Instruct2026.0386.17
ReLopeBackbone=Phi-4-Multimodal-Instruct2026.0385.9
ReLopeBackbone=Gemma3-12B2026.0385.73
Attention ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.0384.34
ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.0382.03
Attention ProbeBackbone=Phi-4-Multimodal-Instruct2026.0380.27
ProbeBackbone=Phi-4-Multimodal-Instruct2026.0376.23
ProbeBackbone=Gemma3-12B2026.0375.13
Attention ProbeBackbone=Gemma3-12B2026.0374.58
Cascade RoutingBackbone=Qwen2.5-VL-7B-Instruct2026.0373.15
Post-Hoc EmbedBackbone=Phi-4-Multimodal-Instruct2026.0372.66
MoTBackbone=Qwen2.5-VL-7B-Instruct2026.0372.35
Post-Hoc EmbedBackbone=Gemma3-12B2026.0371.92
RouteLLMBackbone=Phi-4-Multimodal-Instruct2026.0370.81
Cascade RoutingBackbone=Phi-4-Multimodal-Instruct2026.0370.04
Post-Hoc EmbedBackbone=Qwen2.5-VL-7B-Instruct2026.0369.92
RouteLLMBackbone=Qwen2.5-VL-7B-Instruct2026.0368.51
MoTBackbone=Phi-4-Multimodal-Instruct2026.0368.42
MoTBackbone=Gemma3-12B2026.0368.05
RouteLLMBackbone=Gemma3-12B2026.0366.1
Cascade RoutingBackbone=Gemma3-12B2026.0364.91