Multimodal Reasoning on MMBench EN V1.1
80.68AccuracyWSVD-noQ
Evaluation results
| Method | Links | |
|---|---|---|
| WSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=90%2026.05 | 80.68 | |
| LASER-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=90%2026.05 | 80.68 | |
| FP16Backbone=Qwen2-VL 7B2026.05 | 80.52 | |
| QSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=90%2026.05 | 80.16 | |
| LASER-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=80%2026.05 | 80.1 | |
| WSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=80%2026.05 | 80 | |
| QSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=80%2026.05 | 79.79 | |
| SVD-LLMBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=90%2026.05 | 79.12 | |
| LASER-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=70%2026.05 | 79.12 | |
| SVD-LLMBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=80%2026.05 | 78.29 | |
| QSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=70%2026.05 | 76.69 | |
| LASER-noQBackbone=Qwen2-VL 7B, Aggregation=Avg.2026.05 | 76.35 | |
| WSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=70%2026.05 | 76.31 | |
| LASER-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=60%2026.05 | 75.43 | |
| QSVD-noQBackbone=Qwen2-VL 7B, Aggregation=Avg.2026.05 | 74.24 | |
| SVD-LLMBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=70%2026.05 | 73.92 | |
| WSVD-noQBackbone=Qwen2-VL 7B, Aggregation=Avg.2026.05 | 71.41 | |
| QSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=60%2026.05 | 70.06 | |
| LASER-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=90%2026.05 | 67.58 | |
| FP16Backbone=LLaVA-Next 13B2026.05 | 67.53 | |
| WSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=90%2026.05 | 67.48 | |
| LASER-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=80%2026.05 | 67.38 | |
| WSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=60%2026.05 | 67.27 | |
| QSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=90%2026.05 | 67.27 | |
| LASER-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=70%2026.05 | 67.12 | |
| LASER-noQBackbone=LLaVA-Next 13B, Aggregation=Avg.2026.05 | 67.09 | |
| WSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=80%2026.05 | 66.98 | |
| QSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=80%2026.05 | 66.91 | |
| LASER-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=60%2026.05 | 66.91 | |
| QSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=70%2026.05 | 66.86 | |
| WSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=70%2026.05 | 66.86 | |
| WSVD-noQBackbone=LLaVA-Next 13B, Aggregation=Avg.2026.05 | 66.51 | |
| LASER-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=50%2026.05 | 66.44 | |
| LASER-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=50%2026.05 | 66.44 | |
| QSVD-noQBackbone=LLaVA-Next 13B, Aggregation=Avg.2026.05 | 66.23 | |
| QSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=60%2026.05 | 66.18 | |
| WSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=60%2026.05 | 66.08 | |
| FP16Backbone=LLaVA-Next 7B2026.05 | 65.14 | |
| WSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=50%2026.05 | 65.14 | |
| LASER-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=80%2026.05 | 65.09 | |
| SVD-LLMBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=90%2026.05 | 65.09 | |
| LASER-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=90%2026.05 | 64.99 | |
| LASER-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=60%2026.05 | 64.94 | |
| LASER-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=70%2026.05 | 64.88 | |
| WSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=90%2026.05 | 64.84 | |
| QSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=90%2026.05 | 64.83 | |
| WSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=80%2026.05 | 64.83 | |
| LASER-noQBackbone=LLaVA-Next 7B, Aggregation=Avg.2026.05 | 64.83 | |
| SVD-LLMBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=80%2026.05 | 64.52 | |
| QSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=50%2026.05 | 64.51 | |
| FP16Backbone=SmolVLM 2B2026.05 | 64.47 | |
| QSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=80%2026.05 | 64.36 | |
| LASER-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=90%2026.05 | 64.31 | |
| LASER-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=50%2026.05 | 64.26 | |
| WSVD-noQBackbone=LLaVA-Next 7B, Aggregation=Avg.2026.05 | 64.2 | |
| WSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=60%2026.05 | 64.1 | |
| WSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=70%2026.05 | 64.04 | |
| QSVD-noQBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=50%2026.05 | 63.95 | |
| LASER-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=80%2026.05 | 63.79 | |
| QSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=70%2026.05 | 63.64 | |
| WSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=50%2026.05 | 63.21 | |
| LASER-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=70%2026.05 | 62.96 | |
| QSVD-noQBackbone=LLaVA-Next 7B, Aggregation=Avg.2026.05 | 62.94 | |
| LASER-noQBackbone=SmolVLM 2B, Aggregation=Avg.2026.05 | 62.74 | |
| SVD-LLMBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=90%2026.05 | 62.18 | |
| QSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=60%2026.05 | 62.08 | |
| LASER-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=60%2026.05 | 61.56 | |
| FP16Backbone=LLaVA-v1.5 7B2026.05 | 61.56 | |
| LASER-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=90%2026.05 | 61.51 | |
| LASER-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=80%2026.05 | 61.45 | |
| SVD-LLMBackbone=LLaVA-Next 13B, Compression Ratio (ρ1)=70%2026.05 | 61.4 | |
| QSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=90%2026.05 | 61.25 | |
| LASER-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=50%2026.05 | 61.09 | |
| SVD-LLMBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=80%2026.05 | 61.04 | |
| LASER-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=70%2026.05 | 60.88 | |
| WSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=90%2026.05 | 60.82 | |
| WSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=80%2026.05 | 60.51 | |
| SVD-LLMBackbone=Qwen2-VL 7B, Aggregation=Avg.2026.05 | 60.48 | |
| LASER-noQBackbone=LLaVA-v1.5 7B, Aggregation=Avg.2026.05 | 60.34 | |
| QSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=80%2026.05 | 60.21 | |
| QSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=70%2026.05 | 60.17 | |
| LASER-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=60%2026.05 | 60 | |
| WSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=70%2026.05 | 59.94 | |
| QSVD-noQBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=50%2026.05 | 59.79 | |
| QSVD-noQBackbone=LLaVA-v1.5 7B, Aggregation=Avg.2026.05 | 59.36 | |
| WSVD-noQBackbone=LLaVA-v1.5 7B, Aggregation=Avg.2026.05 | 59.3 | |
| WSVD-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=90%2026.05 | 59.06 | |
| WSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=60%2026.05 | 58.64 | |
| QSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=60%2026.05 | 58.6 | |
| QSVD-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=90%2026.05 | 58.39 | |
| SVD-LLMBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=70%2026.05 | 58.34 | |
| LASER-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=50%2026.05 | 57.87 | |
| SVD-LLMBackbone=LLaVA-Next 13B, Aggregation=Avg.2026.05 | 57.57 | |
| SVD-LLMBackbone=LLaVA-Next 7B, Aggregation=Avg.2026.05 | 57.47 | |
| WSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=50%2026.05 | 56.61 | |
| QSVD-noQBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=50%2026.05 | 56.56 | |
| SVD-LLMBackbone=LLaVA-Next 7B, Compression Ratio (ρ1)=60%2026.05 | 55.95 | |
| WSVD-noQBackbone=SmolVLM 2B, Compression Ratio (ρ1)=80%2026.05 | 55.9 | |
| SVD-LLMBackbone=LLaVA-v1.5 7B, Compression Ratio (ρ1)=90%2026.05 | 55.22 | |
| WSVD-noQBackbone=Qwen2-VL 7B, Compression Ratio (ρ1)=50%2026.05 | 52.81 |