Video Multimodal Evaluation on Video-MME
70.9Video-MME ScoreFull Precision
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Full PrecisionModel=InternVL3.5-38B-Instruct, Weight bits=16 bit, Memory=71.51 GB2026.07 | 70.9 | — | — | |
| Full PrecisionModel=InternVL3.5-14B-Instruct, Weight bits=16 bit, Memory=28.16 GB2026.07 | 67.9 | — | — | |
| Full PrecisionModel=InternVL3.5-8B-Instruct, Weight bits=16 bit, Memory=15.89 GB2026.07 | 66.59 | — | — | |
| GPTQModel=InternVL3.5-38B-Instruct, Weight bits=3 bit, Memory=12.71 GB2026.07 | 62.3 | — | — | |
| GPTQModel=InternVL3.5-14B-Instruct, Weight bits=3 bit, Memory=5.38 GB2026.07 | 60.07 | — | — | |
| SAB-LVLMModel=InternVL3.5-38B-Instruct, Weight bits=1.06 bit, Memory=10.27 GB2026.07 | 59.41 | — | — | |
| ARB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.08 bit, Memory=10.27 GB2026.07 | 59.29 | — | — | |
| GPTQModel=InternVL3.5-8B-Instruct, Weight bits=3 bit, Memory=2.83 GB2026.07 | 56.81 | — | — | |
| SAB-LVLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.07 | 51.96 | — | — | |
| ARB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.07 | 51.33 | — | — | |
| PB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB2026.07 | 46.85 | — | — | |
| PB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.70 bit, Memory=2.28 GB2026.07 | 24.67 | — | — | |
| SAB-LVLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.07 | 24 | — | — | |
| PB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.70 bit, Memory=4.34 GB2026.07 | 22.52 | — | — | |
| BiLLMModel=InternVL3.5-38B-Instruct, Weight bits=1.07 bit, Memory=10.72 GB2026.07 | 16.93 | — | — | |
| BiLLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.53 GB2026.07 | 15.63 | — | — | |
| BiLLMModel=InternVL3.5-8B-Instruct, Weight bits=1.08 bit, Memory=2.39 GB2026.07 | 10.52 | — | — | |
| ARB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.07 | 9.89 | — | — | |
| LLaVA-NeXT-Vid.LLM=Vicuna-7B, Use Audio=×, Latency (s)=0.242025.09 | — | 33.8 | 29.1 | |
| LLaVA-OneVisionLLM=Qwen2-7B, Use Audio=×, Latency (s)=0.972025.09 | — | 57.6 | 47.2 | |
| LLaVA-VideoLLM=Qwen2-7B, Use Audio=×, Latency (s)=1.002025.09 | — | 62.2 | 52.6 | |
| Qwen2-VLLLM=Qwen2-7B, Use Audio=×, Latency (s)=1.632025.09 | — | 57.5 | 45.7 | |
| Qwen2.5-OmniLLM=Qwen2.5-7B, Use Audio=✓, Latency (s)=4.122025.09 | — | 66.5 | 56 | |
| UniMambaMiaLLM=Qwen2-7B, Use Audio=✓, Latency (s)=1.602025.09 | — | 65.6 | 56.5 | |
| VAMBALLM=Qwen2-7B, Use Audio=×2025.09 | — | 57.8 | — | |
| Video-LLaMA2LLM=Mistral-7B, Use Audio=✓2025.09 | — | 46.6 | — |