Science Question Answering on SQA (accuracy)
98Accuracy (SQA)Qwen3-VL-235B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-VL-235BToken Retention Ratio=100%2026.05 | 98 | |
| F3AToken Retention Ratio=60%2026.05 | 94.66 | |
| VisionZipToken Retention Ratio=60%2026.05 | 94.1 | |
| DivPruneToken Retention Ratio=60%2026.05 | 94.02 | |
| CDPrunerToken Retention Ratio=60%2026.05 | 93.74 | |
| FastVToken Retention Ratio=60%2026.05 | 93.21 | |
| F3AToken Retention Ratio=40%2026.05 | 92.71 | |
| DivPruneToken Retention Ratio=40%2026.05 | 91.73 | |
| CDPrunerToken Retention Ratio=40%2026.05 | 91.52 | |
| FastVToken Retention Ratio=40%2026.05 | 90.96 | |
| VisionZipToken Retention Ratio=40%2026.05 | 90.88 | |
| F3AToken Retention Ratio=20%2026.05 | 89.53 | |
| Qwen2.5-VL-7BToken Retention=100%2026.06 | 88.4 | |
| CDPrunerToken Retention Ratio=20%2026.05 | 87.62 | |
| DivPruneToken Retention Ratio=20%2026.05 | 87.11 | |
| VisionZipToken Retention Ratio=20%2026.05 | 86.88 | |
| StepPruneBackbone=Qwen2.5-VL-7B, Token Pruning Rate=66.7%2026.06 | 86.7 | |
| FastVToken Retention Ratio=20%2026.05 | 85.9 | |
| StepPruneBackbone=Qwen2.5-VL-7B, Token Pruning Rate=77.8%2026.06 | 85.4 | |
| SPAREToken Retention=20%2026.06 | 84.9 | |
| VanillaBackbone=Qwen2.5-VL-7B, Token Pruning Rate=0%2026.06 | 84.7 | |
| VanillaBackbone=Qwen2-VL-7B, Token Retention Ratio=100.0%2026.06 | 84.6 | |
| CDPrunerToken Retention=20%2026.06 | 84.3 | |
| StepPruneBackbone=Qwen2.5-VL-7B, Token Pruning Rate=88.9%2026.06 | 83.2 | |
| SPAREToken Retention=10%2026.06 | 82.5 | |
| CDPrunerToken Retention=10%2026.06 | 82.1 | |
| HoloVBackbone=Qwen2.5-VL-7B, Token Pruning Rate=66.7%2026.06 | 79.8 | |
| HoloVBackbone=Qwen2.5-VL-7B, Token Pruning Rate=77.8%2026.06 | 79.8 | |
| HoloVBackbone=Qwen2.5-VL-7B, Token Pruning Rate=88.9%2026.06 | 79.5 | |
| DCP-PruneBackbone=Qwen2-VL-7B, Token Retention Ratio=5%2026.06 | 79.1 | |
| FastVBackbone=Qwen2.5-VL-7B, Token Pruning Rate=66.7%2026.06 | 78.5 | |
| SCOPEBackbone=Qwen2-VL-7B, Token Retention Ratio=5%2026.06 | 78.3 | |
| FlowCutBackbone=Qwen2-VL-7B, Token Retention Ratio=5%2026.06 | 78.2 | |
| FastVBackbone=Qwen2.5-VL-7B, Token Pruning Rate=77.8%2026.06 | 78 | |
| FastVBackbone=Qwen2.5-VL-7B, Token Pruning Rate=88.9%2026.06 | 77.4 | |
| LLaVA Vicuna STSMLLM=LLaVA, LLM=Vicuna, Method=STS, Activated Params=0.27B, FLOPs=82.2%2025.09 | 70.2 | |
| Upper BoundBase Model=LLaVA-NeXT-7B, Token Retention Budget=unpruned2026.04 | 70.1 | |
| Mipha Phi-1.5 BaselineMLLM=Mipha, LLM=Phi-1.5, Method=Baseline, Activated Params=1.30B2025.09 | 69.9 | |
| CLASPBase Model=LLaVA-NeXT-7B, Token Retention Budget=640 Tokens2026.04 | 69.8 | |
| Mipha Phi-1.5 STSMLLM=Mipha, LLM=Phi-1.5, Method=STS, Activated Params=1.08B, FLOPs=83.5%2025.09 | 68.9 | |
| LLaVA Vicuna BaselineMLLM=LLaVA, LLM=Vicuna, Method=Baseline, Activated Params=0.32B2025.09 | 68.4 | |
| SparseVLMBase Model=LLaVA-NeXT-7B, Token Retention Budget=640 Tokens2026.04 | 67.6 | |
| CLASPBase Model=LLaVA-NeXT-7B, Token Retention Budget=320 Tokens2026.04 | 67 | |
| SparseVLMBase Model=LLaVA-NeXT-7B, Token Retention Budget=320 Tokens2026.04 | 66.1 | |
| MoE-LLaVA StableLM STSMLLM=MoE-LLaVA, LLM=StableLM, Method=STS, Activated Params=1.33B, FLOPs=83.9%2025.09 | 63.4 | |
| MoE-LLaVA Qwen BaselineMLLM=MoE-LLaVA, LLM=Qwen, Method=Baseline, Activated Params=1.80B2025.09 | 63.1 | |
| MoE-LLaVA StableLM BaselineMLLM=MoE-LLaVA, LLM=StableLM, Method=Baseline, Activated Params=1.60B2025.09 | 62.6 | |
| MoE-LLaVA Qwen STSMLLM=MoE-LLaVA, LLM=Qwen, Method=STS, Activated Params=1.49B, FLOPs=83.9%2025.09 | 62.1 | |
| CLASPBase Model=LLaVA-NeXT-7B, Token Retention Budget=160 Tokens2026.04 | 60.9 | |
| SparseVLMBase Model=LLaVA-NeXT-7B, Token Retention Budget=160 Tokens2026.04 | 57.8 | |
| Mipha Phi-2 BaselineMLLM=Mipha, LLM=Phi-2, Method=Baseline, Activated Params=2.70B2025.09 | 57.5 | |
| Mipha Phi-2 STSMLLM=Mipha, LLM=Phi-2, Method=STS, Activated Params=2.24B, FLOPs=83.8%2025.09 | 55.7 |