Visual Question Answering on MMB
83.2ScoreVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaBackbone=InternVL 2.5 8B, Average Tokens Retained=100%2026.02 | 83.2 | 100 | |
| IVC-PruneBackbone=InternVL 2.5 8B, Average Tokens Retained=50%2026.02 | 83 | 99.6 | |
| IVC-PruneBackbone=Qwen2.5-VL 7B, Average Tokens Retained=50%2026.02 | 82.6 | 100.6 | |
| VanillaBackbone=Qwen2.5-VL 7B, Average Tokens Retained=100%2026.02 | 82.4 | 100 | |
| IVC-PruneBackbone=DeepSeek-VL2 Small-16B, Average Tokens Retained=52%2026.02 | 79.3 | 100.1 | |
| VanillaBackbone=DeepSeek-VL2 Small-16B, Average Tokens Retained=100%2026.02 | 79.2 | 100 | |
| VanillaBackbone=LLaVA-v1.5 7B, Average Tokens Retained=100%2026.02 | 60.6 | 100 | |
| IVC-PruneBackbone=LLaVA-v1.5 7B, Average Tokens Retained=28%2026.02 | 60.6 | 101.3 |