Multimodal Understanding on MMB, MME, POPE, ScienceQA, and TextVQA
82.8MMB ScoreVanilla
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VanillaToken Pruning Rate=0%2026.03 | 82.8 | 2,304 | 86.1 | 84.7 | 84.8 | 100 | |
| AutoSelectToken Pruning Rate=66.7%2026.03 | 81.7 | 2,279 | 84.9 | 86.4 | 79 | 98.3 | |
| AutoSelectToken Pruning Rate=77.8%2026.03 | 81 | 2,218 | 82.8 | 83.7 | 76.7 | 95.9 | |
| HoloVToken Pruning Rate=66.7%2026.03 | 78.3 | 2,093 | 85 | 79.8 | 78.9 | 94.3 | |
| AutoSelectToken Pruning Rate=88.9%2026.03 | 76.7 | 2,113 | 79.8 | 82.9 | 76.7 | 93.1 | |
| HoloVToken Pruning Rate=77.8%2026.03 | 76.5 | 2,043 | 82.3 | 79.8 | 70.3 | 90.8 | |
| FastVToken Pruning Rate=66.7%2026.03 | 75.7 | 2,072 | 82.2 | 78.5 | 77.9 | 92.3 | |
| FastVToken Pruning Rate=77.8%2026.03 | 74.9 | 2,036 | 80.7 | 78 | 69 | 89.2 | |
| HoloVToken Pruning Rate=88.9%2026.03 | 72.4 | 2,006 | 80.7 | 79.5 | 61.8 | 87 | |
| FastVToken Pruning Rate=88.9%2026.03 | 69.2 | 1,940 | 78.6 | 77.4 | 60.3 | 84.3 |