Image Understanding on MMBench CN
60.6AccuracyVanilla
Evaluation Results
| Method | Links | |
|---|---|---|
| VanillaBackbone=LLaVA-Next-7B, Token Reduction Rate=0.0%2025.05 | 60.6 | |
| MoB (with η-prior)Backbone=LLaVA-Next-7B, Objectives=PA VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.05 | 58.9 | |
| DARTBackbone=LLaVA-Next-7B, Objectives=VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.05 | 58.2 | |
| VanillaBase Model=LLaVA-1.5-7B, Retained Tokens=576, Reduction Rate=0%2026.02 | 58.1 | |
| VanillaBackbone=LLaVA-1.5-7B, Token Reduction Rate=0.0%2025.05 | 58.1 | |
| ApETBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.02 | 57.9 | |
| MoB (+ η-prior)Backbone=LLaVA-1.5-7B, Objectives=-, Pruning budget K=192, Token Reduction Rate=66.7%2025.05 | 57.8 | |
| MoB (w/o η-prior)Backbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.05 | 57.5 | |
| DARTBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.05 | 57.5 | |
| MoB (+ η-prior)Backbone=LLaVA-1.5-7B, Objectives=-, Pruning budget K=128, Token Reduction Rate=77.8%2025.05 | 57.5 | |
| MoB (w/o η-prior)Backbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.05 | 57.3 | |
| FastVBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.02 | 57 | |
| FastVBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.05 | 57 | |
| DARTBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.05 | 57 | |
| PDropBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.02 | 56.8 | |
| PDropBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.02 | 56.6 | |
| FastVBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.02 | 56.4 | |
| ApETBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.02 | 56.4 | |
| FastVBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.05 | 56.4 | |
| MustDropBackbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=192, Token Reduction Rate=66.7%2025.05 | 55.8 | |
| MustDropBackbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=128, Token Reduction Rate=77.8%2025.05 | 55.2 | |
| MustDropBackbone=LLaVA-Next-7B, Objectives=PA VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.05 | 55.1 | |
| MoB (+ η-prior)Backbone=LLaVA-1.5-7B, Objectives=-, Pruning budget K=64, Token Reduction Rate=88.9%2025.05 | 54.5 | |
| SparseVLMBackbone=LLaVA-Next-7B, Objectives=PA, Pruning budget K=320, Token Reduction Rate=88.9%2025.05 | 54.5 | |
| ApETBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.02 | 54.4 | |
| MoB (w/o η-prior)Backbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.05 | 54.2 | |
| SparseVLMBase Model=LLaVA-1.5-7B, Retained Tokens=192, Reduction Rate=66.7%2026.02 | 53.7 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Objectives=PA, Pruning budget K=192, Token Reduction Rate=66.7%2025.05 | 53.7 | |
| FasterVLMBackbone=LLaVA-Next-7B, Objectives=VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.05 | 53.5 | |
| DARTBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.05 | 53.2 | |
| MustDropBackbone=LLaVA-1.5-7B, Objectives=PA VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.05 | 53.1 | |
| FastVBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.02 | 52.7 | |
| FastVBackbone=LLaVA-1.5-7B, Objectives=VP, Pruning budget K=64, Token Reduction Rate=88.9%2025.05 | 52.7 | |
| FastVBackbone=LLaVA-Next-7B, Objectives=VP, Pruning budget K=320, Token Reduction Rate=88.9%2025.05 | 51.9 | |
| SparseVLMBase Model=LLaVA-1.5-7B, Retained Tokens=128, Reduction Rate=77.8%2026.02 | 51.1 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Objectives=PA, Pruning budget K=128, Token Reduction Rate=77.8%2025.05 | 51.1 | |
| PDropBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.02 | 50.5 | |
| SparseVLMBase Model=LLaVA-1.5-7B, Retained Tokens=64, Reduction Rate=88.9%2026.02 | 46.1 | |
| SparseVLMBackbone=LLaVA-1.5-7B, Objectives=PA, Pruning budget K=64, Token Reduction Rate=88.9%2025.05 | 46.1 |