Multimodal Question Answering on MMBench Chinese
85.1MMBCN ScoreBaseline
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BaselineBackbone=InternVL3-8B, Retained Tokens=All 1280 Tokens, Reduction Percentage=100%2026.06 | 85.1 | 74.9 | 100 | |
| TOPSBackbone=InternVL3-8B, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.0%2026.06 | 84.6 | 72.4 | 96.7 | |
| FastVBackbone=InternVL3-8B, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.0%2026.06 | 83.7 | 71.2 | 95.1 | |
| BaselineBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=All 1296 Tokens, Reduction Percentage=100%2026.06 | 82.9 | 73.1 | 100 | |
| VisionZipBackbone=InternVL3-8B, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.0%2026.06 | 81.2 | 67.8 | 90.5 | |
| DivPruneBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.2%2026.06 | 80.9 | 68.8 | 94.1 | |
| TOPSBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.2%2026.06 | 80.5 | 70.4 | 96.3 | |
| DivPruneBackbone=InternVL3-8B, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.0%2026.06 | 80.5 | 69.3 | 92.5 | |
| TOPSBackbone=InternVL3-8B, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.0%2026.06 | 80.5 | 68.8 | 91.9 | |
| CDPrunerBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.2%2026.06 | 80.1 | 68.9 | 94.3 | |
| FastVBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.2%2026.06 | 78.8 | 67.8 | 92.7 | |
| TOPSBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.1%2026.06 | 78.8 | 67.9 | 92.9 | |
| CDPrunerBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.1%2026.06 | 78.7 | 65.5 | 89.6 | |
| DivPruneBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.1%2026.06 | 78.6 | 65.5 | 89.6 | |
| CDPrunerBackbone=InternVL3-8B, Retained Tokens=256 Tokens, Reduction Percentage=↓ 80.0%2026.06 | 78.3 | 67.4 | 90 | |
| DivPruneBackbone=InternVL3-8B, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.0%2026.06 | 75.7 | 64.6 | 86.2 | |
| FastVBackbone=InternVL3-8B, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.0%2026.06 | 73.5 | 60.4 | 80.6 | |
| CDPrunerBackbone=InternVL3-8B, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.0%2026.06 | 73.5 | 62.8 | 83.8 | |
| VisionZipBackbone=InternVL3-8B, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.0%2026.06 | 73.5 | 60.3 | 80.5 | |
| FastVBackbone=Qwen2.5-VL-7B-Instruct, Retained Tokens=128 Tokens, Reduction Percentage=↓ 90.1%2026.06 | 68.8 | 57 | 78 |