Video Reasoning on TempCompass
86.7ScoreGPT-5
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-52026.06 | 86.7 | |
| Gemini-2.5-Pro2026.06 | 84.3 | |
| Gemini-1.5-Pro2026.06 | 75 | |
| OursSize=7B, #Frames=322026.06 | 74.5 | |
| Ours(wo-mv)Size=7B, #Frames=322026.06 | 73.8 | |
| V-Reason-7BFrames/Resolution=32/1282025.10 | 73.3 | |
| Video-R1-7BFrames/Resolution=32/1282025.10 | 73.3 | |
| Video-R1Size=7B, #Frames=322026.06 | 73.2 | |
| Video-R1-7BFrames=322026.07 | 73.2 | |
| Video-R1-7BFrames=642026.07 | 73.2 | |
| VideoChat-R1Size=7B, #Frames=162026.06 | 72.9 | |
| Video-R1-7BFrames=162026.07 | 72.6 | |
| LATENT-VC-9BFrames=162026.07 | 72.6 | |
| LATENT-VC-9BFrames=322026.07 | 72.6 | |
| LATENT-VC-9BFrames=642026.07 | 72.6 | |
| Qwen2.5-VL-7BSize=7B2026.06 | 72.5 | |
| Qwen2.5-VL-7BFrames/Resolution=32/1282025.10 | 72.4 | |
| V-Reason-7B (Lite)Frames/Resolution=32/1282025.10 | 72.4 | |
| V-Reason-7BFrames/Resolution=16/2562025.10 | 72.3 | |
| Qwen2.5-VL-7BFrames/Resolution=16/2562025.10 | 72.2 | |
| Video-R1-7BFrames/Resolution=16/2562025.10 | 72.2 | |
| Qwen3.5-9BSFT+GRPOFrames=162026.07 | 72.2 | |
| Qwen3.5-9BSFT+GRPOFrames=322026.07 | 72.2 | |
| Qwen3.5-9BSFT+GRPOFrames=642026.07 | 72.2 | |
| GPT-4o2026.06 | 71.9 | |
| Video-R1-wo-imageSize=7B, #Frames=322026.06 | 71.8 | |
| V-Reason-7B (Lite)Frames/Resolution=16/2562025.10 | 71.6 | |
| Qwen2.5-VL-7B-SFTSize=7B, #Frames=322026.06 | 69.9 | |
| Video-R1-wo-imageSize=7B, #Frames=162026.06 | 69.8 | |
| Qwen3.5-9BCoTFrames=162026.07 | 66.6 | |
| Qwen3.5-9BCoTFrames=322026.07 | 66.5 | |
| Qwen3.5-9BCoTFrames=642026.07 | 66.5 | |
| LLaVA-OneVisionSize=7B, #Frames=642026.06 | 64.2 | |
| KangarooSize=8B, #Frames=642026.06 | 62.5 | |
| Kangaroo-8BFrames=-2026.07 | 62.5 | |
| Video-UTR-7B2025.10 | 59.7 | |
| Video-UTR-7BFrames=-2026.07 | 59.7 | |
| VILA-1.5-8B2025.10 | 58.8 | |
| VILA-1.5-8BFrames=-2026.07 | 58.8 | |
| LongVA-7B2025.10 | 56.9 | |
| LongVA-7BFrames=-2026.07 | 56.9 | |
| LLaMA-VID2025.10 | 45.6 | |
| LLaMA-VIDFrames=-2026.07 | 45.6 | |
| V-Reason-3BFrames/Resolution=32/1282025.10 | 30.4 | |
| V-Reason-3B (Lite)Frames/Resolution=32/1282025.10 | 29.1 | |
| Qwen2.5-VL-3BFrames/Resolution=32/1282025.10 | 28.1 |