Multimodal Benchmarking on MMBench EN
80.5Accuracy (MMB)Vanilla
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VanillaViT token retention rate=100%, LLM token retention rate=100%2026.04 | 80.5 | 100 | 100 | 31.9 | 76.6 | — | |
| SparseVLMViT token retention rate=35%, LLM token retention rate=35%2026.04 | 80.4 | 106.6 | 94.8 | 18.8 | 29.8 | — | |
| FastVViT token retention rate=35%, LLM token retention rate=35%2026.04 | 80 | 82.1 | 74.3 | 19.5 | 32.6 | — | |
| V2 DropViT token retention rate=35%, LLM token retention rate=35%2026.04 | 79.9 | 81.3 | 74.6 | 21.9 | 39 | — | |
| DARTViT token retention rate=35%, LLM token retention rate=35%2026.04 | 79.7 | 82.4 | 78.6 | 20.6 | 34.5 | — | |
| SparseVLMViT token retention rate=20%, LLM token retention rate=20%2026.04 | 79.2 | 92.4 | 80.7 | 16.4 | 20.6 | — | |
| V2 DropViT token retention rate=20%, LLM token retention rate=20%2026.04 | 78.1 | 74.2 | 68 | 18.8 | 27.6 | — | |
| DARTViT token retention rate=20%, LLM token retention rate=20%2026.04 | 77.8 | 75 | 74.7 | 18 | 25 | — | |
| DASHViT token retention rate=35%, LLM token retention rate=35%2026.04 | 77.5 | 70.6 | 74.8 | 13.1 | 35.6 | — | |
| FastVViT token retention rate=20%, LLM token retention rate=20%2026.04 | 77.4 | 76.6 | 65.3 | 17 | 23 | — | |
| ToFuViT token retention rate=35%, LLM token retention rate=35%2026.04 | 73.9 | 67.5 | 54.1 | 12.3 | 29.6 | — | |
| DASHViT token retention rate=20%, LLM token retention rate=20%2026.04 | 73.9 | 61.6 | 62.5 | 12.6 | 20.2 | — | |
| ToMeViT token retention rate=35%, LLM token retention rate=35%2026.04 | 72.6 | 65.9 | 54.2 | 12 | 30.4 | — | |
| DART (ViT)ViT token retention rate=35%, LLM token retention rate=35%2026.04 | 70.6 | 67.1 | 58 | 11.7 | 29.7 | — | |
| CDPrunerRetained Tokens=640, Token Reduction Ratio=77.8%, Backbone=LLaVA-NeXT-13B2026.06 | 69.1 | — | — | — | — | 98.3 | |
| DARTRetained Tokens=640, Token Reduction Ratio=77.8%, Backbone=LLaVA-NeXT-13B2026.06 | 68.6 | — | — | — | — | 100.7 | |
| SPARERetained Tokens=640, Token Reduction Ratio=77.8%, Backbone=LLaVA-NeXT-13B2026.06 | 68.6 | — | — | — | — | 99.1 | |
| LLaVA-NeXT-13BRetained Tokens=2880, Token Reduction Ratio=100%, Backbone=LLaVA-NeXT-13B2026.06 | 68.5 | — | — | — | — | 100 | |
| ToFuViT token retention rate=20%, LLM token retention rate=20%2026.04 | 67.7 | 57.3 | 53 | 8.4 | 19.1 | — | |
| SPARERetained Tokens=160, Token Reduction Ratio=94.4%, Backbone=LLaVA-NeXT-13B2026.06 | 67.3 | — | — | — | — | 95.6 | |
| SPARERetained Tokens=320, Token Reduction Ratio=88.9%, Backbone=LLaVA-NeXT-13B2026.06 | 67 | — | — | — | — | 97.2 | |
| ToMeViT token retention rate=20%, LLM token retention rate=20%2026.04 | 66.8 | 60.9 | 53.2 | 8.2 | 19.6 | — | |
| DARTRetained Tokens=320, Token Reduction Ratio=88.9%, Backbone=LLaVA-NeXT-13B2026.06 | 66.6 | — | — | — | — | 96.3 | |
| CDPrunerRetained Tokens=320, Token Reduction Ratio=88.9%, Backbone=LLaVA-NeXT-13B2026.06 | 66.5 | — | — | — | — | 97.1 | |
| CDPrunerRetained Tokens=160, Token Reduction Ratio=94.4%, Backbone=LLaVA-NeXT-13B2026.06 | 66.2 | — | — | — | — | 95.2 | |
| DART (ViT)ViT token retention rate=20%, LLM token retention rate=20%2026.04 | 63.9 | 53 | 53.8 | 7.6 | 19 | — | |
| DARTRetained Tokens=160, Token Reduction Ratio=94.4%, Backbone=LLaVA-NeXT-13B2026.06 | 63.6 | — | — | — | — | 89.4 |