Overall Performance on Aggregate 9 benchmarks
64.9Average ScoreLLaVA-1.5-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaVA-1.5-7BRetain Tokens=576, Pruning Ratio=0%2026.07 | 64.9 | |
| EADPRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 63.5 | |
| CDPrunerRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 63.2 | |
| VisionZipRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 62.5 | |
| DivPruneRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 62.5 | |
| EADPRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 62.2 | |
| SparseVLMRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 62.1 | |
| DARTRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 62 | |
| HiPruneRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 61.9 | |
| CDPrunerRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 61.9 | |
| PruMerge+Retain Tokens=128, Pruning Ratio=77.8%2026.07 | 61.8 | |
| TRIMRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 61.7 | |
| PDropRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 61 | |
| DivPruneRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 60.9 | |
| EADPRetain Tokens=32, Pruning Ratio=94.4%2026.07 | 60.9 | |
| CDPrunerRetain Tokens=32, Pruning Ratio=94.4%2026.07 | 60.4 | |
| VisionZipRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 60.3 | |
| TRIMRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 59.9 | |
| DARTRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 59.2 | |
| FastVRetain Tokens=128, Pruning Ratio=77.8%2026.07 | 59.1 | |
| PruMerge+Retain Tokens=64, Pruning Ratio=88.9%2026.07 | 58.7 | |
| DivPruneRetain Tokens=32, Pruning Ratio=94.4%2026.07 | 58.4 | |
| Qwen2.5-Dense2MoELLM=Qwen2.5, Model=Ours, Activated Parameters=1.2 B2026.05 | 58.23 | |
| HiPruneRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 57.9 | |
| DARTRetain Tokens=32, Pruning Ratio=94.4%2026.07 | 56.7 | |
| TRIMRetain Tokens=32, Pruning Ratio=94.4%2026.07 | 56 | |
| VisionZipRetain Tokens=32, Pruning Ratio=94.4%2026.07 | 56 | |
| SparseVLMRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 55.8 | |
| Qwen2.5-DenseLLM=Qwen2.5, Model=Dense, Activated Parameters=1.5 B2026.05 | 55.19 | |
| PruMerge+Retain Tokens=32, Pruning Ratio=94.4%2026.07 | 54.5 | |
| FastVRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 47.3 | |
| PDropRetain Tokens=64, Pruning Ratio=88.9%2026.07 | 47 | |
| Llama2-Dense2MoELLM=Llama2, Model=Ours, Activated Parameters=5.7 B2026.05 | 31.38 | |
| Llama2-DenseLLM=Llama2, Model=Dense, Activated Parameters=7.0 B2026.05 | 27.84 |