Multi-modal Image Understanding on LLaVA-Next-7B Evaluation Suite
64.2GQA ScoreVanilla
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VanillaToken Budget=2880 Tokens, Token Reduction Ratio=100%2026.06 | 64.2 | 67.4 | 60.6 | 1,851 | 86.5 | 70.1 | 64.9 | 57.6 | 51.7 | 100 | |
| CLSEToken Budget=320 Tokens, Token Reduction Ratio=88.9%2026.06 | 62.6 | 67.1 | 58.3 | 1,794 | 84.4 | 67.9 | 58.9 | 56.1 | 41.4 | 94.7 | |
| HiREDToken Budget=320 Tokens, Token Reduction Ratio=88.9%2026.06 | 59.3 | 64.2 | 55.9 | 1,690 | 83.3 | 66.7 | 58.8 | 54.2 | 40.4 | 91.7 | |
| PDropToken Budget=320 Tokens, Token Reduction Ratio=88.9%2026.06 | 56.4 | 63.4 | 56.2 | 1,663 | 77.6 | 67.5 | 54.4 | 54.1 | 25.9 | 86.5 | |
| SparseVLMToken Budget=320 Tokens, Token Reduction Ratio=88.9%2026.06 | 56.1 | 60.6 | 54.5 | 1,533 | 82.4 | 66.1 | 58.4 | 52 | 27 | 85.8 | |
| FastVToken Budget=320 Tokens, Token Reduction Ratio=88.9%2026.06 | 55.9 | 61.6 | 51.9 | 1,661 | 71.7 | 62.8 | 55.7 | 53.1 | 37.4 | 86.3 | |
| PruMergeToken Budget=320 Tokens, Token Reduction Ratio=88.9%2026.06 | 53.6 | 61.3 | 55.3 | 1,534 | 60.8 | 66.4 | 50.6 | 54 | 14.6 | 79.2 |