Video Question Answering on OVO-Bench
65.93Overall AccuracyGemini 1.5 Pro
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 1.5 ProSize=-, Frames=1 fps, Mode=Proprietary2026.05 | 65.93 | |
| Qwen2.5-VL-7B + SAVEMemSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 62.69 | |
| GPT-4oSize=-, Frames=64, Mode=Proprietary2026.05 | 62.6 | |
| ViSpeakSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 61.91 | |
| ThinkStreamSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 59.66 | |
| Qwen2.5-VL-3B + SAVEMemSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 57.34 | |
| StreamForestSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 56.61 | |
| Qwen2-VLSize=7B, Frames=64, Mode=Offline2026.05 | 54.61 | |
| LLaVA-VideoSize=7B, Frames=64, Mode=Offline2026.05 | 52.51 | |
| InternVL2Size=8B, Frames=64, Mode=Offline2026.05 | 52.36 | |
| Qwen2.5-VL-7BSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 52.27 | |
| Qwen2.5-VL-3BSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 52.23 | |
| TimeChat-OnlineSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 51.8 | |
| LongVUSize=7B, Frames=1 fps, Mode=Offline2026.05 | 48.45 | |
| DispiderSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 45.3 | |
| Flash-VStreamSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 27.61 | |
| VideoLLM-OnlineSize=8B, Frames=2 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 19.26 |