Online Visual-Only Question Answering on OVO-bench
95.3OCRStreamOV
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| StreamOV#Frames=1fps2026.05 | 95.3 | 78 | 81 | 66.3 | 85.2 | 76.1 | 79.5 | 66.3 | 75 | 46.2 | 62.4 | 35.4 | 74.4 | 70 | 56.4 | 64 | |
| Qwen3-Omni-30B-A3B#Frames=642026.05 | 79.9 | 61.5 | 75.9 | 54.5 | 77.2 | 64.1 | 68.8 | 57.9 | 67.6 | 37.8 | 55.1 | 37.7 | 70 | 62.9 | 56.9 | 60.3 | |
| TimeChat-Online-7B#Frames=1fps2026.05 | 75.2 | 46.8 | 70.7 | 47.8 | 69.3 | 61.4 | 61.9 | 55.9 | 59.5 | 9.7 | 41.7 | 31.6 | 38.5 | 40 | 36.7 | 46.7 | |
| LLaVA-NeXT-Video-7B#Frames=642026.05 | 69.8 | 59.6 | 66.4 | 50.6 | 72.3 | 61.4 | 63.3 | 51.2 | 64.2 | 9.7 | 41.7 | 34.1 | 67.6 | 60.8 | 54.2 | 53.1 | |
| Qwen2-VL-7B#Frames=642026.05 | 69.1 | 53.2 | 63.8 | 50.6 | 66.3 | 60.9 | 60.7 | 44.4 | 66.9 | 34.4 | 48.6 | 30.1 | 65.7 | 50.8 | 48.9 | 52.7 | |
| InternVL-V2-8B#Frames=642026.05 | 68.5 | 58.7 | 69 | 44.9 | 67.3 | 56 | 60.7 | 43.1 | 61.5 | 27.4 | 44 | 25.8 | 57.6 | 52.9 | 45.4 | 50.1 | |
| StreamForest-7B#Frames=1fps2026.05 | 68.5 | 53.2 | 71.6 | 47.8 | 65.4 | 60.9 | 61.2 | 58.9 | 64.9 | 32.3 | 52 | 32.8 | 70.6 | 57.1 | 53.5 | 55.6 | |
| Qwen2.5-Omni-7B#Frames=642026.05 | 67.8 | 53.2 | 67.2 | 47.2 | 71.3 | 57.6 | 60.7 | 52.2 | 58.1 | 19.9 | 43.4 | 36.3 | 62.8 | 47.5 | 48.9 | 51 | |
| LLaVA-OneVision-7B#Frames=642026.05 | 67.1 | 58.7 | 69.8 | 49.4 | 71.3 | 60.3 | 62.8 | 52.5 | 58.8 | 23.7 | 45 | 24.8 | 66.9 | 60.8 | 50.9 | 52.9 | |
| ROMA-7B#Frames=2fps2026.05 | 63.1 | 53.2 | 68.1 | 39.3 | 69.3 | 58.2 | 58.5 | 55.9 | 47.3 | 23.7 | 42.3 | — | — | — | — | — | |
| Dispider-7B#Frames=1fps2026.05 | 57.7 | 49.5 | 62.1 | 44.9 | 61.4 | 51.6 | 54.5 | 48.5 | 55.4 | 4.3 | 36.1 | 18 | 37.4 | 48.8 | 34.7 | 41.8 | |
| Flash-VStream-7B#Frames=1fps2026.05 | 25.5 | 32.1 | 29.3 | 33.7 | 29.7 | 28.8 | 29.9 | 36.4 | 33.8 | 5.9 | 25.4 | 5.4 | 67.3 | 60 | 44.2 | 33.2 | |
| VideoLLM-online-8B#Frames=2fps2026.05 | 8.1 | 23.9 | 12.1 | 14 | 45.5 | 21.2 | 20.8 | 22.2 | 18.8 | 12.2 | 17.7 | — | — | — | — | — |