Video Question Answering on OVO-Bench Backward Tracing
59.93EPMViSpeak
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ViSpeakSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 59.93 | 48.65 | 63.98 | 57.52 | |
| StreamForestSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 58.92 | 64.86 | 32.26 | 52.02 | |
| Gemini 1.5 ProSize=-, Frames=1 fps, Mode=Proprietary2026.05 | 58.59 | 76.35 | 52.64 | 62.54 | |
| GPT-4oSize=-, Frames=64, Mode=Proprietary2026.05 | 57.91 | 75.68 | 48.66 | 60.75 | |
| TimeChat-OnlineSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 55.9 | 59.5 | 9.7 | 41.7 | |
| ThinkStreamSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 53.87 | 59.46 | 43.55 | 52.3 | |
| Qwen2.5-VL-7BSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 51.52 | 58.78 | 23.66 | 44.65 | |
| LLaVA-VideoSize=7B, Frames=64, Mode=Offline2026.05 | 51.18 | 64.19 | 9.68 | 41.68 | |
| Qwen2.5-VL-7B + SAVEMemSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 50.84 | 62.84 | 37.63 | 50.44 | |
| Qwen2.5-VL-3BSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 49.83 | 53.38 | 26.34 | 43.18 | |
| DispiderSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 48.48 | 55.41 | 4.3 | 36.06 | |
| Qwen2.5-VL-3B + SAVEMemSize=3B, Frames=1 fps, Mode=Online, Training Strategy=Training-Free2026.05 | 47.81 | 56.76 | 29.03 | 44.53 | |
| Qwen2-VLSize=7B, Frames=64, Mode=Offline2026.05 | 44.44 | 66.89 | 34.41 | 48.58 | |
| InternVL2Size=8B, Frames=64, Mode=Offline2026.05 | 43.1 | 61.49 | 27.41 | 44 | |
| LongVUSize=7B, Frames=1 fps, Mode=Offline2026.05 | 43.1 | 66.22 | 9.14 | 39.49 | |
| Flash-VStreamSize=7B, Frames=1 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 36.36 | 33.78 | 5.91 | 25.35 | |
| VideoLLM-OnlineSize=8B, Frames=2 fps, Mode=Online, Training Strategy=Training-Based2026.05 | 22.22 | 18.8 | 12.18 | 17.73 |