Vision-Language Understanding and Reasoning on LLaVA Multimodal Evaluation Suite 1.5 (test/val)
62GQALLaVA-1.5-7B
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLaVA-1.5-7BRetained Tokens=All 576 Tokens, Token Reduction=0%2026.05 | 62 | 64.3 | — | 85.9 | — | 78.5 | 58.2 | — | 31.1 | — | 62.61 | 58.3 | 100 | |
| LiteLVLM‡Retained Tokens=128, Reduction Ratio=↓ 77.8%, Selection Notes=5% similarity-aware tokens retained, remaining are context-aware2026.05 | 58.4 | 62.5 | — | 85.3 | — | 76.6 | 57 | — | 32.9 | — | 61.33 | 56.6 | 97.9 | |
| VisPrunerRetained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 58.2 | 62.7 | — | 84.6 | — | 75.8 | 57 | — | 33.7 | — | 61.32 | 57.3 | 97.9 | |
| LiteLVLMRetained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 58.1 | 61.6 | — | 84.2 | — | 76.1 | 56.9 | — | 31.7 | — | 60.69 | 56.1 | 96.9 | |
| LLaVA-PruMerge+Retained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 57.8 | 61.3 | — | 81.5 | — | 74.7 | 54.3 | — | 28.7 | — | 59 | 54.7 | 94.2 | |
| VisionZipRetained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 57.6 | 62 | — | 83.2 | — | 75.6 | 56.8 | — | 32.6 | — | 60.64 | 56.7 | 96.9 | |
| LiteLVLM‡Retained Tokens=64, Reduction Ratio=↓ 88.9%, Selection Notes=5% similarity-aware tokens retained, remaining are context-aware2026.05 | 56.1 | 61.4 | — | 80.1 | — | 73.2 | 53.6 | — | 30.4 | — | 58.56 | 55.1 | 93.5 | |
| SparseVLMRetained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 56 | 60 | — | 80.5 | — | 73.8 | 54.9 | — | 30 | — | 58.04 | 51.1 | 92.8 | |
| LiteLVLMRetained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 55.5 | 60.1 | — | 78.2 | — | 72.8 | 53.5 | — | 29.6 | — | 57.96 | 54 | 92.6 | |
| VisPrunerRetained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 55.4 | 61.3 | — | 80.4 | — | 72.7 | 55.8 | — | 32.3 | — | 59 | 55.1 | 94.2 | |
| VisionZipRetained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 55.1 | 60.1 | — | 77 | — | 72.4 | 55.5 | — | 31.7 | — | 58.17 | 55.4 | 92.9 | |
| LLaVA-PruMerge+Retained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 54.9 | 59.3 | — | 77.4 | — | 67.4 | 53 | — | 25.9 | — | 55.56 | 51 | 88.8 | |
| LiteLVLM‡Retained Tokens=32, Reduction Ratio=↓ 94.4%, Selection Notes=5% similarity-aware tokens retained, remaining are context-aware2026.05 | 52.8 | 57.7 | — | 74.5 | — | 67.8 | 53.8 | — | 29.1 | — | 55.37 | 51.9 | 88.5 | |
| SparseVLMRetained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 52.7 | 56.2 | — | 75.1 | — | 68.2 | 51.8 | — | 23.3 | — | 53.34 | 46.1 | 85.2 | |
| LiteLVLMRetained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 52.5 | 56.9 | — | 71.5 | — | 67.2 | 52.9 | — | 24.9 | — | 53.6 | 49.3 | 85.7 | |
| ToMeRetained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 52.4 | 53.3 | — | 62.8 | — | 63 | 49.1 | — | 27.2 | — | 50.94 | 48.8 | 81.4 | |
| VisPrunerRetained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 52.2 | 58.4 | — | 72.7 | — | 67.7 | 53.9 | — | 28.8 | — | 55.35 | 52.7 | 88.4 | |
| VisionZipRetained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 51.8 | 57.7 | — | 68.7 | — | 67.1 | 53.1 | — | 25.5 | — | 53.03 | 50.3 | 84.7 | |
| LLaVA-PruMerge+Retained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 51.1 | 56.8 | — | 70.9 | — | 54.9 | 50.6 | — | 21.4 | — | 50.39 | 47 | 80.5 | |
| FastVRetained Tokens=128, Reduction Ratio=↓ 77.8%2026.05 | 49.6 | 56.1 | — | 59.6 | — | 61.8 | 50.6 | — | 28.1 | — | 51.03 | 51.4 | 81.5 | |
| ToMeRetained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 48.6 | 43.7 | — | 52.5 | — | 57.1 | 45.3 | — | 24.1 | — | 44.31 | 38.9 | 70.8 | |
| SparseVLMRetained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 48.3 | 51.4 | — | 67.9 | — | 58.6 | 57.3 | — | 18.6 | — | 48.96 | 40.6 | 78.2 | |
| FastVRetained Tokens=64, Reduction Ratio=↓ 88.9%2026.05 | 46.1 | 48 | — | 48 | — | 55 | 47.8 | — | 25.8 | — | 44.77 | 42.7 | 71.5 | |
| ToMeRetained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 43.6 | 31.6 | — | 39 | — | 46.8 | 38.3 | — | 17.3 | — | 34.96 | 28.1 | 55.9 | |
| FastVRetained Tokens=32, Reduction Ratio=↓ 94.4%2026.05 | 41.5 | 37.8 | — | 32.5 | — | 43.4 | 42.6 | — | 20.7 | — | 36.02 | 33.2 | 57.5 | |
| VanillaBase Model=LLaVA-1.5-7B, Visual Token Count=5762026.01 | 0.619 | 0.647 | 1,862 | 0.859 | 0.695 | 0.785 | 0.582 | 0.586 | 0.311 | 0.501 | 1 | — | — | |
| VisionTrim (Ours)Base Model=LLaVA-1.5-7B, Visual Token Count=1922026.01 | 0.61 | 0.644 | 1,798 | 0.868 | 0.708 | 0.784 | 0.584 | 0.583 | 0.332 | 0.513 | 1.006 | — | — | |
| VScanBase Model=LLaVA-1.5-7B, Visual Token Count=1922026.01 | 0.606 | 0.639 | 1,806 | 0.862 | 0.686 | 0.778 | 0.577 | — | — | 0.504 | 0.989 | — | — | |
| VisionTrim (Ours)Base Model=LLaVA-1.5-7B, Visual Token Count=1282026.01 | 0.603 | 0.64 | 1,788 | 0.866 | 0.697 | 0.782 | 0.582 | 0.575 | 0.327 | 0.514 | 0.999 | — | — | |
| VScanBase Model=LLaVA-1.5-7B, Visual Token Count=1282026.01 | 0.598 | 0.63 | 1,792 | 0.861 | 0.689 | 0.771 | 0.573 | — | — | 0.517 | 0.986 | — | — | |
| VisionZipBase Model=LLaVA-1.5-7B, Visual Token Count=1922026.01 | 0.593 | 0.63 | 1,783 | 0.853 | 0.689 | 0.768 | 0.573 | 0.564 | 0.317 | 0.505 | 0.983 | — | — | |
| VisionTrim (Ours)Base Model=LLaVA-1.5-7B, Visual Token Count=642026.01 | 0.588 | 0.63 | 1,780 | 0.862 | 0.71 | 0.768 | 0.568 | 0.548 | 0.322 | 0.523 | 0.988 | — | — | |
| VScanBase Model=LLaVA-1.5-7B, Visual Token Count=642026.01 | 0.583 | 0.621 | 1,698 | 0.85 | 0.691 | 0.754 | 0.556 | — | — | 0.518 | 0.968 | — | — | |
| SparseVLMBase Model=LLaVA-1.5-7B, Visual Token Count=1922026.01 | 0.576 | 0.625 | 1,721 | 0.836 | 0.691 | 0.756 | 0.561 | 0.558 | 0.302 | 0.5 | 0.964 | — | — | |
| VisionZipBase Model=LLaVA-1.5-7B, Visual Token Count=1282026.01 | 0.576 | 0.62 | 1,762 | 0.832 | 0.689 | 0.756 | 0.568 | 0.549 | 0.326 | 0.5 | 0.972 | — | — | |
| PDropBase Model=LLaVA-1.5-7B, Visual Token Count=1922026.01 | 0.573 | 0.633 | 1,797 | 0.848 | 0.692 | 0.764 | 0.565 | 0.572 | 0.308 | 0.5 | 0.976 | — | — | |
| PDropBase Model=LLaVA-1.5-7B, Visual Token Count=1282026.01 | 0.571 | 0.616 | 1,761 | 0.826 | 0.684 | 0.76 | 0.566 | 0.562 | 0.31 | 0.496 | 0.965 | — | — | |
| SparseVLMBase Model=LLaVA-1.5-7B, Visual Token Count=1282026.01 | 0.56 | 0.6 | 1,696 | 0.805 | 0.671 | 0.738 | 0.549 | 0.534 | 0.3 | 0.51 | 0.942 | — | — | |
| VisionZipBase Model=LLaVA-1.5-7B, Visual Token Count=642026.01 | 0.551 | 0.601 | 1,690 | 0.77 | 0.69 | 0.724 | 0.555 | 0.522 | 0.317 | 0.519 | 0.944 | — | — | |
| SparseVLMBase Model=LLaVA-1.5-7B, Visual Token Count=642026.01 | 0.527 | 0.562 | 1,505 | 0.751 | 0.622 | 0.682 | 0.518 | 0.511 | 0.233 | 0.496 | 0.867 | — | — | |
| PDropBase Model=LLaVA-1.5-7B, Visual Token Count=642026.01 | 0.475 | 0.588 | 1,561 | 0.762 | 0.69 | 0.733 | 0.506 | 0.53 | 0.305 | 0.502 | 0.908 | — | — |