Video Question Answering on Video-MME (All, Long)
75VQA Score (All)Gemini-1.5-Pro
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-1.5-Pro2025.03 | 75 | 67.4 | |
| GPT-4o2025.03 | 71.9 | 65.3 | |
| VideoMindSize=7B2025.03 | 58.2 | 49.2 | |
| VideoMindSize=2B2025.03 | 53.6 | 45.4 | |
| LongVASize=7B2025.03 | 52.6 | 46.2 | |
| VideoChat-TPOSize=7B2025.03 | 48.8 | 41 | |
| Video-LLaVASize=7B2025.03 | 41.1 | 37.8 | |
| PLLAVASize=34B2025.03 | 40 | 34.7 | |
| MovieChatSize=7B2025.03 | 38.2 | 33.4 | |
| TimeChatSize=7B2025.03 | 34.3 | 32.1 |