Multimodal Reasoning on ScienceQA-IMG (test)
84.58AccuracyLASER-noQ
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LASER-noQModel Backbone=SmolVLM 2B, Compression Ratio (rho1)=90%2026.05 | 84.58 | — | |
| FP16Model Backbone=SmolVLM 2B2026.05 | 84.58 | — | |
| QSVD-noQModel Backbone=SmolVLM 2B, Compression Ratio (rho1)=90%2026.05 | 77 | — | |
| WSVD-noQModel Backbone=SmolVLM 2B, Compression Ratio (rho1)=90%2026.05 | 76.3 | — | |
| LASER-noQModel Backbone=Qwen2-VL 7B, Compression Ratio (rho1)=50%2026.05 | 75.41 | — | |
| LASER-noQModel Backbone=LLaVA-Next 13B, Compression Ratio (rho1)=50%2026.05 | 73.67 | — | |
| LASER-noQModel Backbone=LLaVA-Next 7B, Compression Ratio (rho1)=50%2026.05 | 70.8 | — | |
| LASER-noQModel Backbone=LLaVA-v1.5 7B, Compression Ratio (rho1)=50%2026.05 | 66.73 | — | |
| SVD-LLMModel Backbone=SmolVLM 2B, Compression Ratio (rho1)=90%2026.05 | 40.06 | — |