Visual Question Answering on VQA v2 (VQAv2 and Average Score)
81.8VQAv2 AccuracyVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaToken Budget=2880, Retention Ratio=100%2026.05 | 81.8 | 100 | |
| VanillaRetained Tokens=576, Token Reduction Ratio=100%2026.03 | 80.4 | 100 | |
| LRCPToken Budget=640, Retention Ratio=↓ 77.8%2026.05 | 79.6 | 98.3 | |
| ApETToken Budget=640, Retention Ratio=↓ 77.8%2026.05 | 79.2 | 97.6 | |
| VisionZipRetained Tokens=192, Token Reduction Ratio=↓ 66.7%2026.03 | 79.1 | 98.3 | |
| PRUNESIDRetained Tokens=192, Token Reduction Ratio=↓ 66.7%2026.03 | 79.1 | 98.7 | |
| VisionZipToken Budget=640, Retention Ratio=↓ 77.8%2026.05 | 79.1 | 97.4 | |
| CoMPPruning Mode=C, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=2.942026.04 | 78.8 | — | |
| LLaVA-1.5-7BVision Token=5762026.03 | 78.5 | — | |
| UncompressedPruning Mode=/, Pruning Ratio=/, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=5.632026.04 | 78.5 | — | |
| DARTPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=3.182026.04 | 78.2 | — | |
| QMoPVision Token=1442026.03 | 78.1 | — | |
| PDropPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=3.092026.04 | 77.9 | — | |
| PRUNESIDRetained Tokens=128, Token Reduction Ratio=↓ 77.8%2026.03 | 77.8 | 97.4 | |
| VisionZipRetained Tokens=128, Token Reduction Ratio=↓ 77.8%2026.03 | 77.5 | 96.2 | |
| VisionZipPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=3.012026.04 | 77.4 | — | |
| SparseVLMToken Budget=640, Retention Ratio=↓ 77.8%2026.05 | 77.1 | 95.7 | |
| DivPrunePruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=3.012026.04 | 76.9 | — | |
| VisionZipPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=3.012026.04 | 76.8 | — | |
| DARTVision Token=1922026.03 | 76.7 | — | |
| DARTPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=3.182026.04 | 76.7 | — | |
| LRCPToken Budget=320, Retention Ratio=↓ 88.9%2026.05 | 76.7 | 95.3 | |
| CoMPPruning Mode=C, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=2.072026.04 | 76.5 | — | |
| VisionZipToken Budget=320, Retention Ratio=↓ 88.9%2026.05 | 76.2 | 93.6 | |
| MustDropVision Token=1922026.03 | 76 | — | |
| ApETToken Budget=320, Retention Ratio=↓ 88.9%2026.05 | 75.8 | 94.2 | |
| SparseVLMToken Budget=320, Retention Ratio=↓ 88.9%2026.05 | 75.7 | 93.7 | |
| SparseVLMVision Token=1922026.03 | 75.6 | — | |
| SparseVLMPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=3.012026.04 | 75.6 | — | |
| PRUNESIDRetained Tokens=64, Token Reduction Ratio=↓ 88.9%2026.03 | 75.2 | 94.4 | |
| PDropVision Token=1922026.03 | 75.1 | — | |
| PDropPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=3.092026.04 | 75.1 | — | |
| HiREDVision Token=1922026.03 | 74.9 | — | |
| DARTPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=2.382026.04 | 74.6 | — | |
| LRCPToken Budget=160, Retention Ratio=↓ 94.4%2026.05 | 74.6 | 91.8 | |
| VisionZipPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=2.162026.04 | 74.2 | — | |
| DivPrunePruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=2.162026.04 | 74.1 | — | |
| VisionZipRetained Tokens=64, Token Reduction Ratio=↓ 88.9%2026.03 | 73.9 | 92.4 | |
| ApETToken Budget=160, Retention Ratio=↓ 94.4%2026.05 | 72.7 | 90.1 | |
| VisionZipPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=2.162026.04 | 72.4 | — | |
| DARTPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=2.382026.04 | 72.4 | — | |
| VisionZipToken Budget=160, Retention Ratio=↓ 94.4%2026.05 | 71.4 | 88.6 | |
| LLaVA-PruMergeVision Token=1922026.03 | 70.6 | — | |
| PDropPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=true, TFLOPs=2.162026.04 | 70.3 | — | |
| PDropPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=2.162026.04 | 69.2 | — | |
| SparseVLMPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=2.152026.04 | 68.2 | — | |
| FastVVision Token=1922026.03 | 67.1 | — | |
| FastVPruning Mode=T, Pruning Ratio=0.46, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=3.182026.04 | 67.1 | — | |
| SparseVLMToken Budget=160, Retention Ratio=↓ 94.4%2026.05 | 66.3 | 80.2 | |
| FastVPruning Mode=T, Pruning Ratio=0.62, Backbone=LLaVA-v1.5-7B, Supervised fine-tuning=false, TFLOPs=2.382026.04 | 55 | — | |
| ATSBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 66.7 | |
| DASHBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 75.6 | |
| Dynamic-LLaVA-7B_IBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 78 | |
| EViTBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 65.5 | |
| LLaVA-FastVBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 75.1 | |
| LLaVA-HiREDBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 74.7 | |
| LLaVA-PruMerge+Backbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 76.8 | |
| ToMeBackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 66 | |
| VanillaBackbone=Dynamic-LLaVA-7B, Token reduction=0%2026.04 | — | 78.5 | |
| VoCo-LLaMABackbone=Dynamic-LLaVA-7B, Token reduction=25%2026.04 | — | 76.9 |