Multimodal Benchmarking on MMB
100Average PerformanceLLaVA-NeXT-7B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLaVA-NeXT-7BBase Model=LLaVA-NeXT-7B, Retained Tokens=28802026.03 | 100 | 65.8 | — | — | |
| VisionZipBase Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 99.8 | 65.8 | — | — | |
| AgilePrunerBase Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 99.64 | 65.9 | — | — | |
| DivPruneBase Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 98.9 | 65.8 | — | — | |
| SparseVLMBase Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 98.8 | 65.9 | — | — | |
| PruMerge+Base Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 98.3 | 64.6 | — | — | |
| AgilePrunerBase Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 97.94 | 64.5 | — | — | |
| PDropBase Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 97 | 64.1 | — | — | |
| DivPruneBase Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 97 | 63.9 | — | — | |
| VisionZipBase Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 96.4 | 63.3 | — | — | |
| PruMerge+Base Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 95.7 | 63 | — | — | |
| FastVBase Model=LLaVA-NeXT-7B, Retained Tokens=6402026.03 | 95.2 | 63.1 | — | — | |
| SparseVLMBase Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 94.6 | 63.1 | — | — | |
| PDropBase Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 82.5 | 55.5 | — | — | |
| FastVBase Model=LLaVA-NeXT-7B, Retained Tokens=3202026.03 | 79.9 | 53.4 | — | — | |
| TPRLBackbone=LLaVA-1.5-VL-13B, Token=192*2026.03 | 68.95 | — | 100.5 | — | |
| LLaVA-1.5-VL-13BBackbone=LLaVA-1.5-VL-13B, Token=5762026.03 | 68.64 | — | 100 | — | |
| TPRLBackbone=LLaVA-1.5-VL-13B, Token=128*2026.03 | 67.5 | — | 98.3 | — | |
| FastVBackbone=LLaVA-1.5-VL-13B, Token=1922026.03 | 64.8 | — | 94.5 | — | |
| VanillaBackbone=LLaVA-1.5-7B, Retained Tokens=5762026.04 | 64.3 | 100 | — | 100 | |
| VisionZipBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 64.1 | 98.75 | — | 99.69 | |
| RCPBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 63.61 | 99.06 | — | 98.93 | |
| DARTBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 63.21 | 98.57 | — | 98.3 | |
| PDropBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 62.89 | 97.07 | — | 97.8 | |
| HiREDBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 62.41 | 96.53 | — | 97.06 | |
| FastVBackbone=LLaVA-1.5-VL-13B, Token=1282026.03 | 61.2 | — | 89.2 | — | |
| FastVBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 61.2 | 88.71 | — | 95.18 | |
| HiREDBackbone=LLaVA-1.5-7B, Retained Tokens=1282026.04 | 61.12 | 95.2 | — | 95.05 | |
| PDropBackbone=LLaVA-1.5-7B, Retained Tokens=1282026.04 | 60.8 | 95.08 | — | 94.55 | |
| DARTBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 60.23 | 94.4 | — | 93.66 | |
| ToMeBackbone=LLaVA-1.5-7B, Retained Tokens=1922026.04 | 60.13 | 88.32 | — | 93.51 | |
| VisionZipBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 60.1 | 94.81 | — | 93.47 | |
| HiREDBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 59.83 | 91.46 | — | 93.04 | |
| RCPBackbone=LLaVA-1.5-7B, Retained Tokens=1282026.04 | 59.34 | 96.73 | — | 92.29 | |
| RCPBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 59.29 | 95 | — | 92.21 | |
| FastVBackbone=LLaVA-1.5-7B, Retained Tokens=1282026.04 | 56.1 | 82.86 | — | 87.25 | |
| ToMeBackbone=LLaVA-1.5-7B, Retained Tokens=1282026.04 | 52.97 | 82.75 | — | 82.38 | |
| FastVBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 47.7 | 73.88 | — | 74.19 | |
| ToMeBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 43.43 | 73.34 | — | 67.54 | |
| PDropBackbone=LLaVA-1.5-7B, Retained Tokens=642026.04 | 33.09 | 75.89 | — | 51.47 | |
| ID-SelectionImportance Criterion=LLM second-layer cross-modal attention, Retain Tokens=642026.04 | — | 61.8 | — | — | |
| ID-SelectionImportance Criterion=LLM second-layer cross-modal attention, Retain Tokens=322026.04 | — | 60.9 | — | — | |
| ID-SelectionImportance Criterion=unified score, Retain Tokens=162026.04 | — | 58.8 | — | — | |
| LLaVA-1.5-7BRetain Tokens=5762026.04 | — | 64.3 | — | — |