Science Question Answering on ScienceQA (EM)
88.45Exact Match (EM)Baseline
Evaluation results
| Method | Links | |
|---|---|---|
| BaselineCompression Ratio=0%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 88.45 | |
| IDPrunerCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 85.52 | |
| SCOPECompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 85.23 | |
| VisionSelectorCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 85.08 | |
| DARTCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 84.33 | |
| HiPruneCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 84.18 | |
| VisPrunerCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 84.18 | |
| VisionZipCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 83.99 | |
| DivPruneCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 83.94 | |
| FastVCompression Ratio=75%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 83.49 | |
| VisionZipCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 83.24 | |
| IDPrunerCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 82.8 | |
| HiPruneCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 82.65 | |
| SCOPECompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 82.25 | |
| VisionSelectorCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 81.95 | |
| VisPrunerCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 81.11 | |
| DivPruneCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 80.96 | |
| DARTCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 80.96 | |
| FastVCompression Ratio=90%, Backbone=Qwen-2.5-7B-Instruct2026.02 | 79.28 | |
| IDPrunerRetain Tokens=1282026.02 | 66.88 | |
| IDPrunerRetain Tokens=322026.02 | 66.73 | |
| IDPrunerRetain Tokens=642026.02 | 66.68 | |
| BaselineRetain Tokens=Full2026.02 | 66.19 |