Video Question Answering on OVO-Bench Real-Time Visual Perception
91.95OCRQwen2.5-VL-7B + SAVEMem
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen2.5-VL-7B + SAVEMemSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 91.95 | 68.81 | 81.03 | 65.73 | 70.3 | 71.74 | 74.93 | |
| Qwen2.5-VL-3B + SAVEMemSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 89.26 | 68.81 | 73.28 | 55.62 | 64.36 | 69.57 | 70.15 | |
| Gemini 1.5 ProSize=-, Frames=1 fps, Mode=Proprietary2026.05 | 85.91 | 66.97 | 79.31 | 58.43 | 63.37 | 61.96 | 69.32 | |
| ThinkStreamSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 85.23 | 64.22 | 69.83 | 49.44 | 69.31 | 64.13 | 67.03 | |
| Qwen2.5-VL-3BSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 77.18 | 52.29 | 68.97 | 41.01 | 67.33 | 60.87 | 61.27 | |
| ViSpeakSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 75.2 | 58.72 | 71.55 | 51.12 | 74.26 | 66.85 | 66.3 | |
| TimeChat-OnlineSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 75.2 | 46.8 | 70.7 | 47.8 | 69.3 | 61.4 | 61.9 | |
| GPT-4oSize=-, Frames=64, Mode=Proprietary2026.05 | 69.8 | 64.22 | 71.55 | 51.12 | 70.3 | 59.78 | 64.46 | |
| LLaVA-VideoSize=7B, Frames=64, Mode=Offline2026.05 | 69.8 | 59.63 | 66.38 | 50.56 | 72.28 | 61.41 | 63.34 | |
| Qwen2-VLSize=7B, Frames=64, Mode=Offline2026.05 | 69.13 | 53.21 | 63.79 | 50.56 | 66.34 | 60.87 | 60.65 | |
| InternVL2Size=8B, Frames=64, Mode=Offline2026.05 | 68.46 | 58.72 | 68.97 | 44.94 | 67.33 | 55.98 | 60.73 | |
| StreamForestSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 68.46 | 53.21 | 71.55 | 47.75 | 65.35 | 60.87 | 61.2 | |
| Qwen2.5-VL-7BSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 67.79 | 55.05 | 67.24 | 42.13 | 66.34 | 60.87 | 59.9 | |
| DispiderSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 57.72 | 49.54 | 62.07 | 44.94 | 61.39 | 51.63 | 54.55 | |
| LongVUSize=7B, Frames=1 fps, Mode=Offline2026.05 | 55.7 | 49.54 | 59.48 | 48.31 | 68.32 | 63.04 | 57.4 | |
| Flash-VStreamSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 25.5 | 32.11 | 29.31 | 33.71 | 29.7 | 28.8 | 29.86 | |
| VideoLLM-OnlineSize=8B, Frames=2 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 8.05 | 23.85 | 12.07 | 14.04 | 45.54 | 21.2 | 20.79 |