Science Question Answering on ScienceQA SQA-IMG
92.8AccuracyTroL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TroLModel size=7B2024.06 | 92.8 | — | |
| TroLModel size=3.8B2024.06 | 90.8 | — | |
| Latent DenoisingArchitecture=Qwen-2.5-VL2026.04 | 88.5 | — | |
| Meteor2024.05 | 88.3 | — | |
| Meteor2024.05 | 88.3 | — | |
| Meteor2024.05 | 88.3 | — | |
| TroLModel size=1.8B2024.06 | 87.5 | — | |
| BaselineArchitecture=Qwen-2.5-VL2026.04 | 87.3 | — | |
| ASMv22024.05 | 87.1 | — | |
| ASMv22024.05 | 87.1 | — | |
| ASMv2Model size=7B2024.06 | 87.1 | — | |
| MoAI2024.05 | 83.5 | — | |
| CoLLaVO2024.05 | 83.5 | — | |
| MoAIModel size=7B2024.06 | 83.5 | — | |
| CoLLaVO2024.05 | 80.7 | — | |
| LAF2024.05 | 80.7 | — | |
| CoLLaVOModel size=7B2024.06 | 80.7 | — | |
| MoSLoRAModel=LLaMA-3 + ViT, Initialization=Kaiming uniform2024.06 | 76 | — | |
| MoSLoRAModel=LLaMA-3 + ViT, Initialization=Orthogonal2024.06 | 75.7 | — | |
| LoRAModel=LLaMA-3 + ViT2024.06 | 74.8 | — | |
| HiPruneBackbone=LLaVA-1.5-13B, Token Num=642025.08 | 74.6 | — | |
| MOVA2024.05 | 74.4 | — | |
| MOVA2024.05 | 74.4 | — | |
| MoVAModel size=7B2024.06 | 74.4 | — | |
| HiPruneBackbone=LLaVA-1.5-13B, Token Num=1282025.08 | 74.1 | — | |
| HiPrune++Backbone=LLaVA-1.5-13B, Token Num=642025.08 | 74.1 | — | |
| HiPrune++Backbone=LLaVA-1.5-13B, Token Num=1282025.08 | 73.8 | — | |
| HiPruneBackbone=LLaVA-1.5-13B, Token Num=1922025.08 | 73.7 | — | |
| HiPrune++Backbone=LLaVA-1.5-13B, Token Num=1922025.08 | 73.2 | — | |
| LLaVA-NeXT-13BToken Num=28802025.08 | 73.1 | — | |
| LLaVA-1.5-13BToken Num=5762025.08 | 72.8 | — | |
| QLoRAModel=InternLM2 + ViT, Quantization=4-bit2024.06 | 72.5 | — | |
| Latent DenoisingArchitecture=LLaVA+SigLIP2026.04 | 72.4 | — | |
| QMoSLoRAModel=InternLM2 + ViT, Initialization=Kaiming uniform, Quantization=4-bit2024.06 | 72.2 | — | |
| HiPrune++Backbone=LLaVA-NeXT-13B, Token Num=6402025.08 | 72.2 | — | |
| HiPruneBackbone=LLaVA-NeXT-13B, Token Num=3202025.08 | 72.1 | — | |
| QMoSLoRAModel=InternLM2 + ViT, Initialization=Orthogonal, Quantization=4-bit2024.06 | 71.8 | — | |
| LLaVA-1.5LLM=Vicuna-13B, Resolution=336, Pre-train Sample Size=558K, Finetune Sample Size=665K2024.05 | 71.6 | — | |
| HiPruneBackbone=LLaVA-NeXT-13B, Token Num=6402025.08 | 71.6 | — | |
| HiPrune++Backbone=LLaVA-NeXT-13B, Token Num=3202025.08 | 71.2 | — | |
| HiPrune++Backbone=LLaVA-NeXT-13B, Token Num=1602025.08 | 71.2 | — | |
| DARTSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 71.1 | — | |
| HiPruneBackbone=LLaVA-NeXT-13B, Token Num=1602025.08 | 70.9 | — | |
| BaselineArchitecture=LLaVA+SigLIP2026.04 | 70.6 | — | |
| AlignGPTLLM=Vicuna-13B, Resolution=336, Pre-train Sample Size=558K, Finetune Sample Size=665K2024.05 | 70.3 | — | |
| PDropSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=270, Vision-side TFLOPs (Rel.)=3.54 (46.3%)2026.02 | 70.1 | — | |
| FastVRetained Tokens=64, Reduction Ratio=88.9%2026.02 | 70.1 | 72 | |
| LLaVABackbone=LLaVA-NeXT-7B, Tokens Retained=2880, Retention Ratio=100%2025.08 | 70.1 | — | |
| D²PrunerSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 70 | — | |
| TwigVLMSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 70 | — | |
| DeSAPRetained Tokens=128, Pruning Ratio=↓ 77.8%2026.04 | 69.9 | — | |
| DeSAPRetained Tokens=192, Pruning Ratio=↓ 66.7%2026.04 | 69.9 | — | |
| HoloVRetained Tokens=128, Pruning Ratio=↓ 77.8%2026.04 | 69.8 | — | |
| HoloVRetained Tokens=192, Pruning Ratio=↓ 66.7%2026.04 | 69.8 | — | |
| Delta-LLaVASparsity Op.=false, Sparsity Tok.=true, Vision-side Token=16, Vision-side TFLOPs (Rel.)=0.21 (2.7%)2026.02 | 69.7 | — | |
| DeSAPRetained Tokens=64, Pruning Ratio=↓ 88.9%2026.04 | 69.6 | — | |
| LLaVA-1.5-7BSparsity Op.=false, Sparsity Tok.=false, Vision-side Token=576, Vision-side TFLOPs (Rel.)=7.65 (100.0%)2026.02 | 69.5 | — | |
| HoloVSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 69.5 | — | |
| FiCoCo-LSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=58, Vision-side TFLOPs (Rel.)=0.75 (9.9%)2026.02 | 69.5 | — | |
| CDPrunerSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=32, Vision-side TFLOPs (Rel.)=0.42 (5.4%)2026.02 | 69.5 | — | |
| LLaVA-1.5-7BRetained Tokens=All 576, Reduction Ratio=100%2026.02 | 69.5 | 100 | |
| LLaVA-1.5-7BRetained Tokens=576, Pruning Ratio=100%2026.04 | 69.5 | — | |
| HoloVRetained Tokens=64, Pruning Ratio=↓ 88.9%2026.04 | 69.5 | — | |
| BaselineArchitecture=LLaVA+CLIP2026.04 | 69.5 | — | |
| DOPCDSparsity Op.=true, Sparsity Tok.=true, Vision-side Token=32, Vision-side TFLOPs (Rel.)=0.42 (5.4%)2026.02 | 69.3 | — | |
| ViCA+PDrop†Sparsity Op.=true, Sparsity Tok.=true, Vision-side Token=12, Vision-side TFLOPs (Rel.)=0.16 (2.0%)2026.02 | 69.3 | — | |
| DARTRetained Tokens=64, Reduction Ratio=88.9%2026.02 | 69.3 | 90.8 | |
| FSRRetained Tokens=64, Reduction Ratio=88.9%2026.02 | 69.3 | 96.1 | |
| V2DropRetained Tokens=192, Pruning Ratio=↓ 66.7%2026.04 | 69.3 | — | |
| OmniFusion2024.05 | 69.2 | — | |
| OmniFusion2024.05 | 69.2 | — | |
| OmniFusionModel size=7B2024.06 | 69.2 | — | |
| VisPrunerSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=32, Vision-side TFLOPs (Rel.)=0.42 (5.4%)2026.02 | 69.2 | — | |
| FastVRetained Tokens=128, Reduction Ratio=77.8%2026.02 | 69.2 | 89.6 | |
| SparseVLMRetained Tokens=64, Reduction Ratio=88.9%2026.02 | 69.2 | 86 | |
| PyramidDropRetained Tokens=64, Pruning Ratio=↓ 88.9%2026.04 | 69.2 | — | |
| Latent DenoisingArchitecture=LLaVA+CLIP2026.04 | 69.2 | — | |
| FlowCutSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 69.1 | — | |
| VScanSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 69.1 | — | |
| DOPvSparsity Op.=true, Sparsity Tok.=true, Vision-side Token=32, Vision-side TFLOPs (Rel.)=0.42 (5.4%)2026.02 | 69.1 | — | |
| Dynamic-LLaVASparsity Op.=false, Sparsity Tok.=true, Vision-side Token=115, Vision-side TFLOPs (Rel.)=1.50 (19.6%)2026.02 | 69.1 | — | |
| FSRRetained Tokens=192, Reduction Ratio=66.7%2026.02 | 69.1 | 99.1 | |
| DARTRetained Tokens=128, Reduction Ratio=77.8%2026.02 | 69.1 | 95.2 | |
| FlowCutRetained Tokens=64, Pruning Ratio=↓ 88.9%2026.04 | 69.1 | — | |
| PDropSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 69 | — | |
| SparseVLMRetained Tokens=128, Reduction Ratio=77.8%2026.02 | 69 | 95.6 | |
| VisPrunerRetained Tokens=128, Reduction Ratio=77.8%2026.02 | 69 | 96.7 | |
| CDPrunerRetained Tokens=128, Reduction Ratio=77.8%2026.02 | 69 | 97.6 | |
| VisionZipRetained Tokens=64, Reduction Ratio=88.9%2026.02 | 69 | 92.7 | |
| VisionZipRetained Tokens=64, Pruning Ratio=↓ 88.9%2026.04 | 69 | — | |
| SparseVLMRetained Tokens=192, Pruning Ratio=↓ 66.7%2026.04 | 69 | — | |
| PyramidDropRetained Tokens=192, Pruning Ratio=↓ 66.7%2026.04 | 69 | — | |
| HiPruneSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 68.9 | — | |
| HoloVRetained Tokens=128, Reduction Ratio=77.8%2026.02 | 68.9 | 96.1 | |
| V2DropRetained Tokens=64, Pruning Ratio=↓ 88.9%2026.04 | 68.9 | — | |
| VisionZipRetained Tokens=128, Pruning Ratio=↓ 77.8%2026.04 | 68.9 | — | |
| VisionZipRetained Tokens=192, Pruning Ratio=↓ 66.7%2026.04 | 68.9 | — | |
| VisPrunerBackbone=LLaVA-NeXT-7B, Tokens Retained=160, Retention Ratio=5.6%2025.08 | 68.9 | — | |
| VisionZipSparsity Op.=false, Sparsity Tok.=true, Vision-side Token=64, Vision-side TFLOPs (Rel.)=0.83 (10.9%)2026.02 | 68.8 | — | |
| CDPrunerRetained Tokens=192, Reduction Ratio=66.7%2026.02 | 68.8 | 98.5 |