Vision-Language Evaluation on SEED-Bench
74.74AccuracyFP16
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FP16Backbone=Molmo 7B-O2026.04 | 74.74 | — | — | |
| SVD-LLMBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=90%2026.04 | 74.68 | — | — | |
| WSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=90%2026.04 | 74.61 | — | — | |
| WSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=80%2026.04 | 74.52 | — | — | |
| WSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=70%2026.04 | 74.48 | — | — | |
| QSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=90%2026.04 | 74.47 | — | — | |
| SVD-LLMBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=80%2026.04 | 74.46 | — | — | |
| QSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=80%2026.04 | 74.44 | — | — | |
| ASVDBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=90%2026.04 | 74.42 | — | — | |
| QSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=70%2026.04 | 74.41 | — | — | |
| WSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=60%2026.04 | 74.38 | — | — | |
| QSVD-noQBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=60%2026.04 | 74.37 | — | — | |
| SVD-LLMBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=70%2026.04 | 74.23 | — | — | |
| ASVDBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=80%2026.04 | 74.21 | — | — | |
| SVD-LLMBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=60%2026.04 | 74.11 | — | — | |
| ASVDBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=70%2026.04 | 73.73 | — | — | |
| ASVDBackbone=Molmo 7B-O, Singular-value ratio (ρ1)=60%2026.04 | 73.62 | — | — | |
| IO-SVDModel=SmolVLM 2B, Ratio=80%2026.05 | 68.65 | — | — | |
| FP16Model=SmolVLM 2B, Ratio=100%2026.05 | 68.47 | — | — | |
| IO-SVDModel=SmolVLM 2B, Ratio=90%2026.05 | 68.36 | — | — | |
| IO-SVDModel=SmolVLM 2B, Ratio=70%2026.05 | 68.15 | — | — | |
| WSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=60%2026.04 | 63.68 | — | — | |
| WSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=70%2026.04 | 63.6 | — | — | |
| WSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=80%2026.04 | 63.53 | — | — | |
| FP16Backbone=Qwen-VL 7B2026.04 | 63.52 | — | — | |
| WSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=90%2026.04 | 63.32 | — | — | |
| QSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=90%2026.04 | 63.25 | — | — | |
| QSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=80%2026.04 | 63 | — | — | |
| SVD-LLMBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=90%2026.04 | 62.99 | — | — | |
| SVD-LLMBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=80%2026.04 | 62.8 | — | — | |
| SVD-LLMBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=70%2026.04 | 62.69 | — | — | |
| IO-SVDModel=LLaVA1.5 13B, Ratio=90%2026.05 | 62.64 | — | — | |
| FP16Model=LLaVA1.5 13B, Ratio=100%2026.05 | 62.53 | — | — | |
| SVD-LLMBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=60%2026.04 | 62.51 | — | — | |
| IO-SVDModel=LLaVA1.5 13B, Ratio=80%2026.05 | 62.49 | — | — | |
| IO-SVDModel=LLaVA1.5 13B, Ratio=70%2026.05 | 62.46 | — | — | |
| IO-SVDModel=LLaVA1.5 13B, Ratio=60%2026.05 | 62.45 | — | — | |
| IO-SVDModel=LLaVA1.5 13B, Ratio=50%2026.05 | 62.29 | — | — | |
| QSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=70%2026.04 | 62.06 | — | — | |
| ASVDBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=90%2026.04 | 61.67 | — | — | |
| QSVD-noQBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=60%2026.04 | 61.26 | — | — | |
| ASVDBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=80%2026.04 | 61 | — | — | |
| IO-SVDModel=LLaVA1.5 7B, Ratio=50%2026.05 | 60.64 | — | — | |
| IO-SVDModel=LLaVA1.5 7B, Ratio=80%2026.05 | 60.32 | — | — | |
| IO-SVDModel=LLaVA1.5 7B, Ratio=90%2026.05 | 60.29 | — | — | |
| IO-SVDModel=LLaVA1.5 7B, Ratio=70%2026.05 | 60.22 | — | — | |
| FP16Model=LLaVA1.5 7B, Ratio=100%2026.05 | 60.18 | — | — | |
| IO-SVDModel=LLaVA1.5 7B, Ratio=60%2026.05 | 60.15 | — | — | |
| ASVDBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=70%2026.04 | 59.94 | — | — | |
| ASVDBackbone=Qwen-VL 7B, Singular-value ratio (ρ1)=60%2026.04 | 58.69 | — | — | |
| BLIP-22024.05 | — | 46.4 | — | |
| GIFTModel=LLaVA-1.5 7B2025.10 | — | 65.6 | — | |
| GIFTModel=LLaVA-1.5 13B2025.10 | — | 67.7 | — | |
| GIFTModel=Qwen2-VL 7B2025.10 | — | 76 | — | |
| GIFTModel=Qwen3-VL 8B2025.10 | — | 78.3 | — | |
| GreedyModel=LLaVA-1.5 7B2025.10 | — | 65.5 | — | |
| GreedyModel=LLaVA-1.5 13B2025.10 | — | 67.8 | — | |
| GreedyModel=Qwen2-VL 7B2025.10 | — | 76 | — | |
| GreedyModel=Qwen3-VL 8B2025.10 | — | 78.4 | — | |
| IDEFICS2024.05 | — | 45 | — | |
| InstructBLIP2024.05 | — | 53.4 | — | |
| LLaVA-1.5-7BSIMA=false2024.05 | — | 58.6 | — | |
| LLaVA-1.5-7BSIMA=true2024.05 | — | 60.6 | — | |
| mPLUG-Owl22024.05 | — | 57.8 | — | |
| Qwen-VL-Chat2024.05 | — | 58.2 | — | |
| Rel-AttnModel=LLaVA-1.5 7B2025.10 | — | 65 | — | |
| Rel-AttnModel=LLaVA-1.5 13B2025.10 | — | 66.7 | — | |
| VAFModel=LLaVA-1.5 7B2025.10 | — | 64.9 | — | |
| VAFModel=LLaVA-1.5 13B2025.10 | — | 67 | — | |
| VARModel=LLaVA-1.5 7B2025.10 | — | 65.4 | — | |
| VARModel=LLaVA-1.5 13B2025.10 | — | 67.9 | — | |
| VCDModel=LLaVA-1.5 7B2025.10 | — | 63.5 | — | |
| VCDModel=LLaVA-1.5 13B2025.10 | — | 66.3 | — | |
| VILA-7BSIMA=false2024.05 | — | 61.1 | — | |
| VILA-7BSIMA=true2024.05 | — | 62.5 | — |