Conventional Video Understanding on VideoMMe, MVBench
75VideoMMe ScoreGemini 1.5 Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 1.5 ProBackbone=Proprietary2025.12 | 75 | 60.5 | 67.8 | |
| GPT-4oBackbone=Proprietary2025.12 | 71.9 | 49.1 | 60.5 | |
| RRPOBackbone=LLaVA-Video-7B, Training-free=false2025.12 | 53.8 | 58.1 | 56 | |
| SEASONBackbone=LLaVA-Video-7B, Training-free=true2025.12 | 53.4 | 57.9 | 55.6 | |
| DINO-HEALBackbone=LLaVA-Video-7B, Training-free=true2025.12 | 53.2 | 58.3 | 55.8 | |
| LLaVA-Video-7BBackbone=LLaVA-Video-7B2025.12 | 53 | 58.4 | 55.7 | |
| TCDBackbone=LLaVA-Video-7B, Training-free=true2025.12 | 53 | 57.5 | 55.3 | |
| TPOBackbone=LLaVA-Video-7B, Training-free=false2025.12 | 53 | 58.2 | 55.6 | |
| SEASONBackbone=LLaVA-OV-7B, Training-free=true2025.12 | 50.7 | 54.8 | 52.7 | |
| LLaVA-OV-7BBackbone=LLaVA-OV-7B2025.12 | 50.6 | 54.4 | 52.5 | |
| DINO-HEALBackbone=LLaVA-OV-7B, Training-free=true2025.12 | 50.6 | 54.4 | 52.5 | |
| TCDBackbone=LLaVA-OV-7B, Training-free=true2025.12 | 50.4 | 54.3 | 52.4 | |
| SEASONBackbone=QWEN2.5-VL-7B, Training-free=true2025.12 | 50.4 | 62.3 | 56.4 | |
| QWEN2.5-VL-7BBackbone=QWEN2.5-VL-7B2025.12 | 49.9 | 61.8 | 55.8 | |
| DINO-HEALBackbone=QWEN2.5-VL-7B, Training-free=true2025.12 | 49.9 | 61.9 | 55.9 | |
| ArrowRLBackbone=QWEN2.5-VL-7B, Training-free=false2025.12 | 49.6 | 59.8 | 54.7 | |
| TCDBackbone=QWEN2.5-VL-7B, Training-free=true2025.12 | 49.4 | 60.1 | 54.7 |