List your company
ResearchFormerly WizWand

Video Understanding on VSI-Bench (Score %)

37VSI-Bench ScoreFull Precision
3.657612.313820.9729.6262Jun 1, 2026Jun 6, 2026Jun 11, 2026Jun 16, 2026Jun 21, 2026Jun 26, 2026Jul 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Full PrecisionModel=Qwen2.5-VL-72B-Instruct, Weight bits=16 bit, Memory=136.74 GB, Evaluation protocol=zero-shot2026.0737
Full PrecisionModel=Qwen2.5-VL-32B-Instruct, Weight bits=16 bit, Memory=62.31 GB, Evaluation protocol=zero-shot2026.0736.99
MOSS-Video-PreviewSFT Mode=real-time2026.0636.2
GPTQModel=Qwen2.5-VL-72B-Instruct, Weight bits=3 bit, Memory=28.61 GB, Evaluation protocol=zero-shot2026.0734.71
SAB-LVLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.07 bit, Memory=23.23 GB, Evaluation protocol=zero-shot2026.0734.18
GPTQModel=Qwen2.5-VL-32B-Instruct, Weight bits=3 bit, Memory=12.71 GB, Evaluation protocol=zero-shot2026.0733.9
MOSS-Video-PreviewSFT Mode=offline2026.0633.48
ARB-LLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.19 bit, Memory=23.23 GB, Evaluation protocol=zero-shot2026.0733.4
GPTQModel=Qwen2.5-VL-7B-Instruct, Weight bits=3 bit, Memory=2.66 GB, Evaluation protocol=zero-shot2026.0733.16
Full PrecisionModel=Qwen2.5-VL-7B-Instruct, Weight bits=16 bit, Memory=15.45 GB, Evaluation protocol=zero-shot2026.0729.75
SAB-LVLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.07 bit, Memory=10.28 GB, Evaluation protocol=zero-shot2026.0729.05
Qwen2.5-VLScale=7B2026.0628.3
SAB-LVLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.07 bit, Memory=2.14 GB, Evaluation protocol=zero-shot2026.0726.01
ARB-LLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.07 bit, Memory=2.14 GB, Evaluation protocol=zero-shot2026.0725.89
BiLLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.08 bit, Memory=24.23 GB, Evaluation protocol=zero-shot2026.0725.76
ARB-LLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.16 bit, Memory=10.28 GB, Evaluation protocol=zero-shot2026.0725.12
BiLLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.08 bit, Memory=10.73 GB, Evaluation protocol=zero-shot2026.0717.65
PB-LLMModel=Qwen2.5-VL-72B-Instruct, Weight bits=1.70 bit, Memory=22.99 GB, Evaluation protocol=zero-shot2026.0717.27
PB-LLMModel=Qwen2.5-VL-32B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB, Evaluation protocol=zero-shot2026.0715.21
BiLLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.08 bit, Memory=2.24 GB, Evaluation protocol=zero-shot2026.0713.12
PB-LLMModel=Qwen2.5-VL-7B-Instruct, Weight bits=1.17 bit, Memory=2.15 GB, Evaluation protocol=zero-shot2026.074.94