Long video understanding on VideoMME w/o sub
87AccuracyGemini 2.5 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 2.5 ProEvaluation frame rate=1 FPS, self-collected via API=true2025.05 | 87 | |
| Seed1.5-VLThinking mode=true, Evaluation frame rate=1 FPS2025.05 | 77.9 | |
| Seed1.5-VLThinking mode=false, Evaluation frame rate=1 FPS2025.05 | 77.6 | |
| VideoSeek#Frames=60.92026.03 | 70.1 | |
| GPT-5 (Base)#Frames=3842026.03 | 67.9 | |
| Gemini 1.5 Pro#Frames=1,2332026.03 | 67.4 | |
| DVD#Frames=4,9322026.03 | 67.3 | |
| GPT-4o#Frames=3842026.03 | 65.3 | |
| Gemini 2.0 Flash#Frames=1,2332026.03 | 63 | |
| MR. Video#Frames=4,9322026.03 | 61.8 | |
| VCA#Frames=18.12026.03 | 54.2 | |
| Qwen2.5-VL-72B#Frames=2562026.03 | 53.2 | |
| VideoTree#Frames=98.02026.03 | 53.1 | |
| DrVideo#Frames=493.22026.03 | 51.7 | |
| VideoAgent#Frames=24.62026.03 | 46.4 |