Chart Question Answering on ChartQA (AUC Reported)
87.95AUCReLope
Evaluation Results
| Method | Links | |
|---|---|---|
| ReLopeBackbone=Gemma3-12B2026.03 | 87.95 | |
| ReLopeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 86.51 | |
| Attention ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 85.43 | |
| ProbeBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 82.51 | |
| ReLopeBackbone=Phi-4-Multimodal-Instruct2026.03 | 81.47 | |
| Attention ProbeBackbone=Gemma3-12B2026.03 | 81.32 | |
| Attention ProbeBackbone=Phi-4-Multimodal-Instruct2026.03 | 78.63 | |
| ProbeBackbone=Gemma3-12B2026.03 | 76.88 | |
| MoTBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 75.38 | |
| RouteLLMBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 74.89 | |
| RouteLLMBackbone=Gemma3-12B2026.03 | 74.65 | |
| ProbeBackbone=Phi-4-Multimodal-Instruct2026.03 | 73.76 | |
| Post-Hoc EmbedBackbone=Gemma3-12B2026.03 | 73.42 | |
| Cascade RoutingBackbone=Gemma3-12B2026.03 | 73.29 | |
| Post-Hoc EmbedBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 72.75 | |
| Post-Hoc EmbedBackbone=Phi-4-Multimodal-Instruct2026.03 | 70.58 | |
| RouteLLMBackbone=Phi-4-Multimodal-Instruct2026.03 | 70.46 | |
| MoTBackbone=Gemma3-12B2026.03 | 70.16 | |
| Cascade RoutingBackbone=Qwen2.5-VL-7B-Instruct2026.03 | 69.58 | |
| MoTBackbone=Phi-4-Multimodal-Instruct2026.03 | 67.17 | |
| Cascade RoutingBackbone=Phi-4-Multimodal-Instruct2026.03 | 62.93 |