Video Question Answering on LVBench (KIR, EU, Sum, ER, Rea, TG Metrics)
60.7Overall ScoreLongVideo-R1
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LongVideo-R1updated_version=true, video_caption_generator=Qwen3-VL-32B-Instruct, SFT_data=renewed2026.02 | 60.7 | 70.1 | 57.8 | 55.2 | 60.9 | 50.2 | 62.7 | |
| Qwen3-VLModel Class=8B2026.05 | 58 | — | — | — | — | — | — | |
| LLaVA-OV-2Model Class=8B2026.05 | 55.5 | — | — | — | — | — | — | |
| AdaReTake-72B2026.02 | 53.3 | 62.2 | 50.7 | 37.9 | 53 | 54.7 | 45.5 | |
| LongVideo-R12026.02 | 50 | 56.4 | 48.4 | 43.1 | 49.2 | 44.3 | 56.4 | |
| GPT-4o-202411202026.02 | 48.9 | 48.1 | 49.5 | 50 | 48.9 | 50.3 | 40.9 | |
| GLM-4V-plus-01112026.02 | 48.7 | 54.1 | 47.8 | 37.9 | 46.2 | 46.5 | 42.7 | |
| LOVE-R1Size=7B2026.01 | 48.2 | — | — | — | — | — | — | |
| VideoChat-Flash-7B2026.02 | 48.2 | 49 | 46 | 34.5 | 51.1 | 48.5 | 38.9 | |
| ReTake-7B2026.02 | 47.8 | 52.9 | 46.2 | 27.6 | 49.8 | 45.8 | 45 | |
| Video-o3 (SFT+RL)Size=7B2026.01 | 47.6 | — | — | — | — | — | — | |
| Video-o3 (RL)Size=7B2026.01 | 47.5 | — | — | — | — | — | — | |
| InternVL-3.5Model Class=8B2026.05 | 46.7 | — | — | — | — | — | — | |
| SEALLLM Size=34B2024.12 | 45.9 | 51.5 | 41.3 | 39.7 | 47.9 | 43.3 | 32.3 | |
| Qwen2.5-VLSize=7B2026.01 | 45.3 | — | — | — | — | — | — | |
| VideoLLaMA3-7B2026.02 | 45.3 | 47.8 | 42.4 | 36.2 | 45.8 | 45.8 | 35.9 | |
| PLMModel Class=8B2026.05 | 44.5 | — | — | — | — | — | — | |
| MemVid2026.02 | 44.4 | 37.8 | 40.6 | 28.1 | 53.4 | 43.2 | 43.9 | |
| InternVL2.5-78B2026.02 | 43.6 | 42.1 | 42 | 37.9 | 43.8 | 51 | 36.8 | |
| Rewatch-R1Size=7B2026.01 | 43.3 | — | — | — | — | — | — | |
| Keye-VL-1.5Model Class=8B2026.05 | 42.8 | — | — | — | — | — | — | |
| Video-ZoomerSize=7B2026.01 | 41.5 | — | — | — | — | — | — | |
| Qwen2-VLLLM Size=72B2024.12 | 41.3 | 38.3 | 41.1 | 46.6 | 38 | 46.5 | 41.4 | |
| LongVTSize=7B2026.01 | 41.3 | — | — | — | — | — | — | |
| TimeMarker-8B2026.02 | 41.3 | 34.9 | 39.1 | 48.8 | 42.8 | 38.2 | 38.7 | |
| Qwen2-VL-72B2026.02 | 41.3 | 38.3 | 41.1 | 46.6 | 38 | 46.5 | 41.4 | |
| VCA2026.02 | 41.3 | 37.8 | 40.8 | 27.3 | 43.7 | 46.2 | 38 | |
| LLaVA-OV-1.5Model Class=8B2026.05 | 40.1 | — | — | — | — | — | — | |
| InternVL2LLM Size=34B2024.12 | 39.6 | 43.4 | 39.7 | 41.4 | 37.4 | 42.5 | 31.4 | |
| ConanSize=7B2026.01 | 39.2 | — | — | — | — | — | — | |
| Video-MTRSize=7B2026.01 | 38.6 | — | — | — | — | — | — | |
| Video-ThinkerSize=7B2026.01 | 37 | — | — | — | — | — | — | |
| Gemini 1.5 Pro2026.02 | 33.1 | 39.3 | 30.9 | 32.8 | 32.1 | 27 | 31.8 | |
| LLaVA-NeXTLLM Size=34B2024.12 | 32.2 | 34.1 | 31.2 | 27.6 | 30.1 | 35 | 31.4 | |
| OryxLLM Size=34B2024.12 | 30.4 | 32.1 | 29.2 | 27.6 | 30.1 | 34 | 29.1 | |
| VideoAgent2026.02 | 29.3 | 28 | 30.3 | 36.4 | 28 | 28 | 29.3 | |
| VideoTree2026.02 | 28.8 | 26.5 | 25.1 | 25.5 | 30.3 | 31.9 | 27.7 | |
| PLLAVALLM Size=34B2024.12 | 26.1 | 26.2 | 24.9 | 25.9 | 25 | 30 | 21.4 |