Video Reasoning on MVBench
84.3MVBench ScoreGemini-2.5-Pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-2.5-Pro2026.06 | 84.3 | — | |
| GPT-52026.06 | 83.3 | — | |
| GPT-4o2026.06 | 73.8 | — | |
| Gemini-1.5-Pro2026.06 | 67.1 | — | |
| OursSize=7B, #Frames=322026.06 | 65.9 | — | |
| Ours(wo-mv)Size=7B, #Frames=322026.06 | 65.2 | — | |
| TriageModel=Qwen2-VL-7B, Retention Ratio=100%2026.01 | 64.7 | — | |
| VanillaModel=Qwen2-VL-7B, Retention Ratio=100%2026.01 | 64.5 | — | |
| Video-R1-7BFrames/Resolution=32/1282025.10 | 64.1 | — | |
| Video-R1-7BFrames/Resolution=16/2562025.10 | 63.9 | — | |
| Video-R1Size=7B, #Frames=322026.06 | 63.9 | — | |
| TriageModel=Qwen2-VL-7B, Retention Ratio=75%2026.01 | 63.8 | — | |
| TriageModel=Qwen2-VL-7B, Retention Ratio=25%2026.01 | 63.7 | — | |
| Video-R1-wo-imageSize=7B, #Frames=322026.06 | 63.2 | — | |
| VideoChat-R1Size=7B, #Frames=162026.06 | 63.1 | — | |
| TriageModel=Qwen2-VL-7B, Retention Ratio=50%2026.01 | 63 | — | |
| KangarooSize=8B, #Frames=642026.06 | 61.1 | — | |
| V-Reason-7BFrames/Resolution=16/2562025.10 | 61 | — | |
| V-Reason-7BFrames/Resolution=32/1282025.10 | 60.9 | — | |
| Video-R1-wo-imageSize=7B, #Frames=162026.06 | 60.9 | — | |
| V-Reason-7B (Lite)Frames/Resolution=16/2562025.10 | 60.8 | — | |
| Qwen2.5-VL-7BFrames/Resolution=32/1282025.10 | 60.7 | — | |
| V-Reason-7B (Lite)Frames/Resolution=32/1282025.10 | 60.6 | — | |
| Qwen2.5-VL-7B-SFTSize=7B, #Frames=322026.06 | 60.5 | — | |
| Qwen2.5-VL-7BFrames/Resolution=16/2562025.10 | 60.4 | — | |
| PyramidDropModel=Qwen2-VL-7B, Retention Ratio=50%2026.01 | 60 | — | |
| Qwen2.5-VL-7BSize=7B2026.06 | 59.4 | — | |
| TriageModel=LLaVA-Video-7B, Retention Ratio=100%2026.01 | 59.2 | — | |
| VanillaModel=LLaVA-Video-7B, Retention Ratio=100%2026.01 | 58.9 | — | |
| Video-UTR-7B2025.10 | 58.8 | — | |
| FastVModel=Qwen2-VL-7B, Retention Ratio=50%2026.01 | 58.5 | — | |
| DyCokeModel=Qwen2-VL-7B, Retention Ratio=50%2026.01 | 58.5 | — | |
| TriageModel=LLaVA-Video-7B, Retention Ratio=50%2026.01 | 58.3 | — | |
| PyramidDropModel=LLaVA-Video-7B, Retention Ratio=50%2026.01 | 58.2 | — | |
| TriageModel=LLaVA-Video-7B, Retention Ratio=75%2026.01 | 58.1 | — | |
| FastVModel=LLaVA-Video-7B, Retention Ratio=50%2026.01 | 58 | — | |
| DyCokeModel=LLaVA-Video-7B, Retention Ratio=50%2026.01 | 58 | — | |
| LongVASize=7B, #Frames=1282026.06 | 56.9 | — | |
| LLaVA-OneV-7B2025.10 | 56.7 | — | |
| LLaVA-OneVisionSize=7B, #Frames=642026.06 | 56.7 | — | |
| TriageModel=LLaVA-OneVision-7B, Retention Ratio=75%2026.01 | 56.1 | — | |
| TriageModel=LLaVA-OneVision-7B, Retention Ratio=100%2026.01 | 55.9 | — | |
| VanillaModel=LLaVA-OneVision-7B, Retention Ratio=100%2026.01 | 55.8 | — | |
| PyramidDropModel=LLaVA-OneVision-7B, Retention Ratio=50%2026.01 | 55.7 | — | |
| FastVModel=LLaVA-OneVision-7B, Retention Ratio=50%2026.01 | 55.7 | — | |
| TriageModel=LLaVA-OneVision-7B, Retention Ratio=50%2026.01 | 55.7 | — | |
| TriageModel=LLaVA-OneVision-7B, Retention Ratio=25%2026.01 | 55.5 | — | |
| DyCokeModel=LLaVA-OneVision-7B, Retention Ratio=50%2026.01 | 55.3 | — | |
| Video-XLSize=7B, #Frames=1282026.06 | 55.3 | — | |
| TriageModel=LLaVA-Video-7B, Retention Ratio=25%2026.01 | 55.1 | — | |
| VideoLLaMA22025.10 | 54.6 | — | |
| VideoLLaMA2Size=8×7B, #Frames=162026.06 | 53.9 | — | |
| V-Reason-3B (Lite)Frames/Resolution=32/1282025.10 | 53.2 | — | |
| V-Reason-3BFrames/Resolution=32/1282025.10 | 52.9 | — | |
| Qwen2.5-VL-3BFrames/Resolution=32/1282025.10 | 52.5 | — | |
| LLaMA-VID2025.10 | 41.9 | — | |
| AdaFocusReasoning Mode=AutoThink2026.05 | — | 71.15 | |
| BaseTraining Strategy=Base2026.04 | — | 68.27 | |
| CoPDTraining Strategy=CoPD2026.04 | — | 69.16 | |
| Image-ExpertTraining Strategy=Image-Expert2026.04 | — | 67.82 | |
| KangarooFrames=322026.05 | — | 61.1 | |
| Kangaroo-8BFrames=-2026.07 | — | 61.1 | |
| LATENT-VC-9BFrames=162026.07 | — | 62.2 | |
| LATENT-VC-9BFrames=322026.07 | — | 61.9 | |
| LATENT-VC-9BFrames=642026.07 | — | 62.5 | |
| LLaMA-VIDFrames=322026.05 | — | 41.9 | |
| LLaMA-VIDFrames=-2026.07 | — | 41.9 | |
| LLaVA-Octopus2026.05 | — | 51.7 | |
| LLaVA-OneVision-7BFrames=-2026.07 | — | 56.7 | |
| LongVT-RFTFrames=32, method_variant=think with tools2026.05 | — | 53.9 | |
| Mixed RLVRTraining Strategy=Mixed RLVR2026.04 | — | 67.88 | |
| MOPDTraining Strategy=MOPD2026.04 | — | 67.71 | |
| PLLaVAFrames=322026.05 | — | 46.6 | |
| Qwen2.5-VL-7B (Base)Reasoning Mode=✗2026.05 | — | 67.1 | |
| Qwen2.5-VL-7B-Instruct(CoT)Frames=322026.05 | — | 42.4 | |
| Qwen2.5-VL-7B-SFTFrames=322026.05 | — | 60.5 | |
| Qwen3.5-9BCoTFrames=162026.07 | — | 51.8 | |
| Qwen3.5-9BCoTFrames=322026.07 | — | 52.2 | |
| Qwen3.5-9BCoTFrames=642026.07 | — | 52 | |
| Qwen3.5-9BSFT+GRPOFrames=162026.07 | — | 60.7 | |
| Qwen3.5-9BSFT+GRPOFrames=322026.07 | — | 60.7 | |
| Qwen3.5-9BSFT+GRPOFrames=642026.07 | — | 60.8 | |
| ShareGPT4VideoFrames=322026.05 | — | 51.2 | |
| ST-LLMFrames=322026.05 | — | 54.85 | |
| STORMFrames=322026.05 | — | 61.1 | |
| SWIM2026.05 | — | 62.1 | |
| Text-ExpertTraining Strategy=Text-Expert2026.04 | — | 65.73 | |
| Video-CCAMFrames=322026.05 | — | 64.6 | |
| Video-ExpertTraining Strategy=Video-Expert2026.04 | — | 70.86 | |
| Video-R1Reasoning Mode=Think-Only2026.05 | — | 65.5 | |
| Video-R1-7BFrames=322026.05 | — | 62.7 | |
| Video-R1-7BFrames=162026.07 | — | 62.7 | |
| Video-R1-7BFrames=322026.07 | — | 63.9 | |
| Video-R1-7BFrames=642026.07 | — | 64.8 | |
| Video-R1-7B-wo-imageFrames=322026.05 | — | 60.9 | |
| Video-Thinker-7BFrames=32, method_variant=think with video2026.05 | — | 62.4 | |
| Video-UTR-7BFrames=-2026.07 | — | 58.8 | |
| VideoAuto-R1Reasoning Mode=AutoThink2026.05 | — | 69.5 | |
| VideoChat-R1.5Reasoning Mode=Think-Only2026.05 | — | 69.6 | |
| VideoChat2Frames=322026.05 | — | 51.1 |