Video Understanding on OVO-Bench
94OCRHuman Agents
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Human Agents#Frames=-, Processing Mode=Human2025.08 | 94 | 92.6 | 94.8 | 92.7 | 91.1 | 94 | 93.2 | 92.6 | 93 | 91.4 | 92.3 | 95.5 | 89.7 | 93.6 | 92.9 | 92.8 | |
| Gemini 1.5 Pro#Frames=1fps, Processing Mode=Proprietary Multimodal2025.08 | 87.3 | 67 | 80.2 | 54.5 | 68.3 | 67.4 | 70.8 | 68.6 | 75.7 | 52.7 | 62.3 | 35.5 | 74.2 | 61.7 | 57.2 | 65.3 | |
| StreamAgent-7B#Frames=1fps, Processing Mode=Open-source Online2025.08 | 71.2 | 53.2 | 63.6 | 53.9 | 67.3 | 58.7 | 61.3 | 54.8 | 58.1 | 25.8 | 41.7 | 35.9 | 48.4 | 52 | 45.4 | 49.4 | |
| LLaVA-NeXT-Video-7B#Frames=64, Processing Mode=Open-source Offline2025.08 | 69.8 | 59.6 | 66.4 | 50.6 | 72.3 | 61.4 | 63.3 | 51.2 | 64.2 | 9.7 | 41.7 | 34.1 | 67.6 | 60.8 | 54.2 | 53.1 | |
| TimeChat-Online-7B#Frames=1fps, Processing Mode=Open-source Online2025.08 | 69.8 | 48.6 | 64.7 | 44.9 | 68.3 | 55.4 | 58.6 | 53.9 | 62.8 | 9.1 | 42 | 32.5 | 36.5 | 40 | 36.4 | 45.6 | |
| GPT-4o#Frames=64, Processing Mode=Proprietary Multimodal2025.08 | 69.1 | 65.1 | 65.5 | 50 | 68.3 | 63.7 | 63.6 | 49.8 | 71 | 55.4 | 58.7 | 27.6 | 73.2 | 59.4 | 53.4 | 58.6 | |
| Qwen2-VL-7B#Frames=64, Processing Mode=Open-source Offline2025.08 | 69.1 | 53.2 | 63.8 | 50.6 | 66.3 | 60.9 | 60.7 | 44.4 | 66.9 | 34.4 | 48.6 | 30.1 | 65.7 | 50.8 | 48.9 | 52.7 | |
| InternVL-V2-8B#Frames=64, Processing Mode=Open-source Offline2025.08 | 68.5 | 58.7 | 69 | 44.9 | 67.3 | 56 | 60.7 | 43.1 | 61.5 | 27.4 | 44 | 25.8 | 57.6 | 52.9 | 45.4 | 50.1 | |
| LLaVA-OneVision-7B#Frames=64, Processing Mode=Open-source Offline2025.08 | 67.1 | 58.7 | 69.8 | 49.4 | 71.3 | 60.3 | 62.8 | 52.5 | 58.8 | 23.7 | 45 | 24.8 | 66.9 | 60.8 | 50.9 | 52.9 | |
| Dispider#Frames=1fps, Processing Mode=Open-source Online2025.08 | 57.7 | 49.5 | 62.1 | 44.9 | 61.4 | 51.6 | 54.5 | 48.5 | 55.4 | 4.3 | 36.1 | 18 | 37.4 | 48.8 | 34.7 | 41.8 | |
| LongVU-7B#Frames=1fps, Processing Mode=Open-source Offline2025.08 | 55.7 | 49.5 | 59.5 | 48.3 | 68.3 | 63 | 57.4 | 43.1 | 66.2 | 9.1 | 39.5 | 16.6 | 69 | 60 | 48.5 | 48.5 | |
| Flash-VStream-7B#Frames=1fps, Processing Mode=Open-source Online2025.08 | 25.5 | 32.1 | 29.3 | 33.7 | 29.7 | 28.8 | 29.9 | 36.4 | 33.8 | 5.9 | 25.4 | 5.4 | 67.3 | 60 | 44.2 | 33.2 | |
| VideoLLM-online-8B#Frames=2fps, Processing Mode=Open-source Online2025.08 | 8.1 | 23.9 | 12.1 | 14 | 45.5 | 21.2 | 20.8 | 22.2 | 18.8 | 12.2 | 17.7 | — | — | — | — | — |