Video Question Answering on MovieChat Global Breakpoint
74.72Breakpoint AccuracyVideo-QTR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Video-QTR2025.12 | 74.72 | 88.72 | 4.45 | 3.6 | |
| gpt-4.12025.12 | 61.39 | 87.63 | 4.38 | 3.1 | |
| Flash-Vstream2025.12 | 59.6 | 86 | 4.28 | 3.01 | |
| HERMES2025.12 | 57.3 | 78.6 | 3.99 | 2.88 | |
| qwen2.5-vl-max2025.12 | 56.59 | 86.7 | 4.33 | 2.82 | |
| gemini2.5-pro2025.12 | 54.76 | 83.3 | 4.17 | 2.74 | |
| MovieChat2025.12 | 48.3 | 62.3 | 3.23 | 2.57 | |
| Video-ChatGPT2025.12 | 48 | 47.6 | 2.55 | 2.45 | |
| ST-LLM2025.12 | 46.2 | 59.81 | 2.96 | 2.33 | |
| VideoChat2025.12 | 46.1 | 57.8 | 3 | 2.29 | |
| VideoChat2-Mistral2025.12 | 43.03 | 44.62 | 2.23 | 2.18 | |
| VILA-1.52025.12 | 40 | — | — | 2.02 | |
| VideoLLaMA2025.12 | 39.1 | 51.7 | 2.67 | 2.04 | |
| Video-LLaVA2025.12 | 36.3 | 51.6 | 2.64 | 1.88 |