List your company
ResearchFormerly WizWand

Chart Question Answering on ChartQA (AUC Reported)

87.95AUCReLope
61.929268.684675.4482.1954Mar 25, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ReLopeBackbone=Gemma3-12B2026.0387.95
ReLopeBackbone=Qwen2.5-VL-7B-Instruct2026.0386.51
Attention ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.0385.43
ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.0382.51
ReLopeBackbone=Phi-4-Multimodal-Instruct2026.0381.47
Attention ProbeBackbone=Gemma3-12B2026.0381.32
Attention ProbeBackbone=Phi-4-Multimodal-Instruct2026.0378.63
ProbeBackbone=Gemma3-12B2026.0376.88
MoTBackbone=Qwen2.5-VL-7B-Instruct2026.0375.38
RouteLLMBackbone=Qwen2.5-VL-7B-Instruct2026.0374.89
RouteLLMBackbone=Gemma3-12B2026.0374.65
ProbeBackbone=Phi-4-Multimodal-Instruct2026.0373.76
Post-Hoc EmbedBackbone=Gemma3-12B2026.0373.42
Cascade RoutingBackbone=Gemma3-12B2026.0373.29
Post-Hoc EmbedBackbone=Qwen2.5-VL-7B-Instruct2026.0372.75
Post-Hoc EmbedBackbone=Phi-4-Multimodal-Instruct2026.0370.58
RouteLLMBackbone=Phi-4-Multimodal-Instruct2026.0370.46
MoTBackbone=Gemma3-12B2026.0370.16
Cascade RoutingBackbone=Qwen2.5-VL-7B-Instruct2026.0369.58
MoTBackbone=Phi-4-Multimodal-Instruct2026.0367.17
Cascade RoutingBackbone=Phi-4-Multimodal-Instruct2026.0362.93