Visual Question Answering on MathVista
60.3Total AccuracyBase
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BaseRatio=100%, Backbone=Qwen2.5-VL-3B2026.05 | 60.3 | — | — | |
| ERASERatio=-62.1%, Backbone=Qwen2.5-VL-3B2026.05 | 57.3 | — | — | |
| ERASERatio=-75.0%, Backbone=Qwen2.5-VL-3B2026.05 | 57.2 | — | — | |
| PruneSIDRatio=-62.1%, Backbone=Qwen2.5-VL-3B2026.05 | 57 | — | — | |
| IVC-PruneRatio=-62.1%, Backbone=Qwen2.5-VL-3B2026.05 | 55.3 | — | — | |
| DARTRatio=-62.1%, Backbone=Qwen2.5-VL-3B2026.05 | 55.2 | — | — | |
| ERASERatio=-85.0%, Backbone=Qwen2.5-VL-3B2026.05 | 55 | — | — | |
| IVC-PruneRatio=-75.0%, Backbone=Qwen2.5-VL-3B2026.05 | 54.6 | — | — | |
| PruneSIDRatio=-75.0%, Backbone=Qwen2.5-VL-3B2026.05 | 53 | — | — | |
| IVC-PruneRatio=-85.0%, Backbone=Qwen2.5-VL-3B2026.05 | 53 | — | — | |
| CDPrunerRatio=-62.1%, Backbone=Qwen2.5-VL-3B2026.05 | 52.4 | — | — | |
| DARTRatio=-75.0%, Backbone=Qwen2.5-VL-3B2026.05 | 50.9 | — | — | |
| PruneSIDRatio=-85.0%, Backbone=Qwen2.5-VL-3B2026.05 | 49.2 | — | — | |
| CDPrunerRatio=-75.0%, Backbone=Qwen2.5-VL-3B2026.05 | 47.5 | — | — | |
| DARTRatio=-85.0%, Backbone=Qwen2.5-VL-3B2026.05 | 46.9 | — | — | |
| CDPrunerRatio=-85.0%, Backbone=Qwen2.5-VL-3B2026.05 | 46.6 | — | — | |
| TENTType=BP-based, Model=Qwen2.5VL-3B-Instruct2026.03 | 39.6 | 56.7 | 27.4 | |
| ZOTTAType=BP-free, Model=Qwen2.5VL-3B-Instruct2026.03 | 38.9 | 56.7 | 26.2 | |
| FOAType=BP-free, Model=Qwen2.5VL-3B-Instruct2026.03 | 36.1 | 53.3 | 23.8 | |
| NoAdaptType=/, Model=Qwen2.5VL-3B-Instruct2026.03 | 34.7 | 51.7 | 22.6 |