Video Understanding on VSI-Bench (Score %)
37VSI-Bench ScoreFull Precision
Evaluation Results
| Method | Links | |
|---|---|---|
| Full PrecisionModel=Qwen2.5-VL-72B-Instruct, Weight bits=16 bit, Memory=136.74 GB, Evaluation protocol=zero-shot2026.07 | 37 | |
| Full PrecisionModel=Qwen2.5-VL-32B-Instruct, Weight bits=16 bit, Memory=62.31 GB, Evaluation protocol=zero-shot2026.07 | 36.99 | |
| MOSS-Video-PreviewSFT Mode=real-time2026.06 | 36.2 | |
| GPTQModel=Qwen2.5-VL-72B-Instruct, Weight bits=3 bit, Memory=28.61 GB, Evaluation protocol=zero-shot2026.07 | 34.71 | |
| SAB-LVLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.07 bit, Memory=23.23 GB, Evaluation protocol=zero-shot2026.07 | 34.18 | |
| GPTQModel=Qwen2.5-VL-32B-Instruct, Weight bits=3 bit, Memory=12.71 GB, Evaluation protocol=zero-shot2026.07 | 33.9 | |
| MOSS-Video-PreviewSFT Mode=offline2026.06 | 33.48 | |
| ARB-LLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.19 bit, Memory=23.23 GB, Evaluation protocol=zero-shot2026.07 | 33.4 | |
| GPTQModel=Qwen2.5-VL-7B-Instruct, Weight bits=3 bit, Memory=2.66 GB, Evaluation protocol=zero-shot2026.07 | 33.16 | |
| Full PrecisionModel=Qwen2.5-VL-7B-Instruct, Weight bits=16 bit, Memory=15.45 GB, Evaluation protocol=zero-shot2026.07 | 29.75 | |
| SAB-LVLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.07 bit, Memory=10.28 GB, Evaluation protocol=zero-shot2026.07 | 29.05 | |
| Qwen2.5-VLScale=7B2026.06 | 28.3 | |
| SAB-LVLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.07 bit, Memory=2.14 GB, Evaluation protocol=zero-shot2026.07 | 26.01 | |
| ARB-LLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.07 bit, Memory=2.14 GB, Evaluation protocol=zero-shot2026.07 | 25.89 | |
| BiLLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.08 bit, Memory=24.23 GB, Evaluation protocol=zero-shot2026.07 | 25.76 | |
| ARB-LLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.16 bit, Memory=10.28 GB, Evaluation protocol=zero-shot2026.07 | 25.12 | |
| BiLLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.08 bit, Memory=10.73 GB, Evaluation protocol=zero-shot2026.07 | 17.65 | |
| PB-LLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.70 bit, Memory=22.99 GB, Evaluation protocol=zero-shot2026.07 | 17.27 | |
| PB-LLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB, Evaluation protocol=zero-shot2026.07 | 15.21 | |
| BiLLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.08 bit, Memory=2.24 GB, Evaluation protocol=zero-shot2026.07 | 13.12 | |
| PB-LLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.17 bit, Memory=2.15 GB, Evaluation protocol=zero-shot2026.07 | 4.94 |