Multimodal Understanding on MMB, MME, SQA, VQA^T, MMB^C, MMVet, MMstar, AI2D Suite
64.6MMB ScoreLLaVA-1.5-7B
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| LLaVA-1.5-7BRetained Tokens=576, Reduction Rate=0%, FLOPs=8.80T2026.02 | 64.6 | 1,862 | 69.5 | 58.3 | 58.1 | 31.2 | 33.1 | 55.5 | 54.6 | 100 | |
| EntropyPruneRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.72T2026.02 | 64.4 | 1,844 | 69.1 | 57.6 | 57.9 | 31.3 | 31.5 | 51.3 | 53.6 | 98.1 | |
| DARTRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.69T2026.02 | 63.7 | 1,833 | 69 | 57 | 57.1 | 29.3 | 31.4 | 52 | 53.1 | 96.9 | |
| EntropyPruneRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.88T2026.02 | 63.5 | 1,780 | 69.4 | 56.3 | 56.4 | 29.9 | 31.5 | 49.9 | 52.6 | 96 | |
| SparseVLMRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.76T2026.02 | 63.4 | 1,779 | 68.6 | 57.7 | 57.1 | 31.2 | 31.4 | 51.2 | 53 | 97.1 | |
| PDropRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.79T2026.02 | 63.3 | 1,765 | 69.2 | 56.2 | 56.5 | 24.6 | 30.7 | 49.4 | 51.6 | 93.3 | |
| FastVRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.99T2026.02 | 63.2 | 1,796 | 69.1 | 56.4 | 57.4 | 25.8 | 31.1 | 50.4 | 52.2 | 94.6 | |
| CDPrunerRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.76T2026.02 | 63.2 | 1,786 | 68.9 | 57.3 | 55.6 | 32.6 | 31.1 | 50.6 | 52.9 | 97.1 | |
| SparseVLMRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.92T2026.02 | 63.2 | 1,700 | 69.2 | 56.3 | 57.4 | 27.3 | 30.9 | 50.9 | 52 | 94.6 | |
| CDPrunerRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.92T2026.02 | 63 | 1,775 | 69 | 56.2 | 55.2 | 31.5 | 29.9 | 51.2 | 52.4 | 95.9 | |
| FastVRetained Tokens=128, Reduction Rate=77.8%, FLOPs=3.14T2026.02 | 62.5 | 1,735 | 68.4 | 54.7 | 55.2 | 24.2 | 31.1 | 50.2 | 51 | 92.4 | |
| DivPruneRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.73T2026.02 | 62.3 | 1,769 | 68.6 | 56.6 | 56.2 | 29.2 | 31.5 | 50.5 | 52.3 | 95.5 | |
| PDropRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.98T2026.02 | 62.2 | 1,655 | 69.5 | 55.4 | 55.7 | 24.5 | 30.7 | 50.1 | 50.9 | 92.2 | |
| DARTRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.80T2026.02 | 62.1 | 1,800 | 69.1 | 55.7 | 55.7 | 27.2 | 30.8 | 51.1 | 52 | 94.5 | |
| DivPruneRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.88T2026.02 | 61.3 | 1,712 | 68.4 | 56 | 54.8 | 27.1 | 29.7 | 50.3 | 51.1 | 92.9 | |
| PrumergeRetained Tokens=192, Reduction Rate=66.7%, FLOPs=3.71T2026.02 | 56.3 | 1,515 | 63.6 | 50.1 | 51.3 | 20.2 | 22 | 37.6 | 44.4 | 79.2 | |
| PrumergeRetained Tokens=128, Reduction Rate=77.8%, FLOPs=2.87T2026.02 | 54.6 | 1,518 | 63.8 | 50.1 | 50.4 | 20.4 | 21.9 | 38.6 | 44.3 | 79 |