List your company
ResearchFormerly WizWand

Video Multimodal Evaluation on Video-MME

70.9Video-MME ScoreFull Precision
7.449623.922340.39556.8677Jul 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Full PrecisionModel=InternVL3.5-38B-Instruct, Weight bits=16 bit, Memory=71.51 GB2026.0770.9——
Full PrecisionModel=InternVL3.5-14B-Instruct, Weight bits=16 bit, Memory=28.16 GB2026.0767.9——
Full PrecisionModel=InternVL3.5-8B-Instruct, Weight bits=16 bit, Memory=15.89 GB2026.0766.59——
GPTQModel=InternVL3.5-38B-Instruct, Weight bits=3 bit, Memory=12.71 GB2026.0762.3——
GPTQModel=InternVL3.5-14B-Instruct, Weight bits=3 bit, Memory=5.38 GB2026.0760.07——
SAB-LVLMModel=InternVL3.5-38B-Instruct, Weight bits=1.06 bit, Memory=10.27 GB2026.0759.41——
ARB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.08 bit, Memory=10.27 GB2026.0759.29——
GPTQModel=InternVL3.5-8B-Instruct, Weight bits=3 bit, Memory=2.83 GB2026.0756.81——
SAB-LVLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.0751.96——
ARB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.0751.33——
PB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB2026.0746.85——
PB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.70 bit, Memory=2.28 GB2026.0724.67——
SAB-LVLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.0724——
PB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.70 bit, Memory=4.34 GB2026.0722.52——
BiLLMModel=InternVL3.5-38B-Instruct, Weight bits=1.07 bit, Memory=10.72 GB2026.0716.93——
BiLLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.53 GB2026.0715.63——
BiLLMModel=InternVL3.5-8B-Instruct, Weight bits=1.08 bit, Memory=2.39 GB2026.0710.52——
ARB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.079.89——
LLaVA-NeXT-Vid.LLM=Vicuna-7B, Use Audio=×, Latency (s)=0.242025.09—33.829.1
LLaVA-OneVisionLLM=Qwen2-7B, Use Audio=×, Latency (s)=0.972025.09—57.647.2
LLaVA-VideoLLM=Qwen2-7B, Use Audio=×, Latency (s)=1.002025.09—62.252.6
Qwen2-VLLLM=Qwen2-7B, Use Audio=×, Latency (s)=1.632025.09—57.545.7
Qwen2.5-OmniLLM=Qwen2.5-7B, Use Audio=✓, Latency (s)=4.122025.09—66.556
UniMambaMiaLLM=Qwen2-7B, Use Audio=✓, Latency (s)=1.602025.09—65.656.5
VAMBALLM=Qwen2-7B, Use Audio=×2025.09—57.8—
Video-LLaMA2LLM=Mistral-7B, Use Audio=✓2025.09—46.6—