Real-Time Visual Perception on OVO-Bench
94OCRHuman Agents
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Human Agents2026.03 | 94 | 92.6 | 94.8 | 92.7 | 91.1 | 94 | 93.2 | — | |
| Human2026.05 | 94 | 92.6 | 94.8 | 92.7 | 91.1 | 94 | 93.2 | 92.8 | |
| Response-G1Params=8B2026.05 | 90.6 | 74.3 | 75.9 | 59.6 | 69.3 | 71.7 | 73.6 | 61.3 | |
| ThinkStreamModel Category=Open-source Online Models, Model Scale=7B2026.03 | 87.92 | 59.63 | 75 | 53.93 | 70.3 | — | 69.12 | 64.9 | |
| Gemini 1.5 Pro# Frames=1fps2026.03 | 87.3 | 67 | 80.2 | 54.5 | 68.3 | 67.4 | 70.8 | — | |
| Gemini 1.5 Pro2026.05 | 87.3 | 67 | 80.2 | 54.5 | 68.3 | 67.4 | 70.8 | 65.3 | |
| ThinkStreamModel Category=Open-source Online Models, Model Scale=3B2026.03 | 85.23 | 64.22 | 69.82 | 49.43 | 69.31 | 64.13 | 67.03 | 59.66 | |
| StreamoModel Category=Open-source Online Models, Model Scale=3B2026.03 | 78.52 | 52.29 | 67.24 | 44.38 | 55.45 | 71.2 | 61.51 | 51.64 | |
| Qwen2.5-VLModel Category=Open-source Offline Models, Model Scale=32B2026.03 | 77.18 | 58.72 | 68.1 | 50.56 | 74.26 | 57.61 | 64.4 | 57.37 | |
| Qwen2.5-VLModel Category=Open-source Offline Models, Model Scale=3B2026.03 | 76.51 | 44.03 | 67.24 | 42.13 | 68.31 | 61.96 | 60.03 | 51 | |
| Em-Garde-7B# Frames=1fps2026.03 | 76.5 | 61.5 | 65.5 | 47.2 | 70.3 | 57.1 | 63 | — | |
| StreamAgent-7B# Frames=1fps2026.03 | 71.2 | 53.2 | 63.6 | 53.9 | 67.3 | 58.7 | 61.3 | — | |
| StreamAgentParams=7B2026.05 | 71.2 | 53.2 | 63.6 | 53.9 | 67.3 | 58.7 | 61.3 | 49.4 | |
| LLaVA-Video-7B# Frames=642026.03 | 69.8 | 59.6 | 66.4 | 50.6 | 72.3 | 61.4 | 63.3 | — | |
| LLaVA-NeXT-VideoParams=7B2026.05 | 69.8 | 59.6 | 66.4 | 50.6 | 72.3 | 61.4 | 63.3 | 53.1 | |
| TimeChat-OnlineParams=7B2026.05 | 69.8 | 48.6 | 64.7 | 44.9 | 68.3 | 55.4 | 58.6 | 45.6 | |
| LLaVA-VideoModel Category=Open-source Offline Models, Model Scale=7B2026.03 | 69.13 | 58.72 | 68.83 | 49.44 | 74.26 | 59.78 | 63.52 | 51.96 | |
| GPT-4o# Frames=642026.03 | 69.1 | 65.1 | 65.5 | 50 | 68.3 | 63.7 | 63.6 | — | |
| Qwen2-VL-7B# Frames=642026.03 | 69.1 | 53.2 | 63.8 | 50.6 | 66.3 | 60.9 | 60.7 | — | |
| GPT-4o2026.05 | 69.1 | 65.1 | 65.5 | 50 | 68.3 | 63.7 | 63.6 | 58.6 | |
| Qwen2-VLParams=7B2026.05 | 69.1 | 53.2 | 63.8 | 50.6 | 66.3 | 60.9 | 60.7 | 52.7 | |
| InternVL-V2-8B# Frames=642026.03 | 68.5 | 58.7 | 69 | 44.9 | 67.3 | 56 | 60.7 | — | |
| StreamForest-7B# Frames=1fps2026.03 | 68.5 | 53.2 | 71.6 | 47.8 | 65.4 | 60.9 | 61.2 | — | |
| InternVL-V2Params=8B2026.05 | 68.5 | 58.7 | 69 | 44.9 | 67.3 | 56 | 60.7 | 50.1 | |
| StreamForestModel Category=Open-source Online Models, Model Scale=7B2026.03 | 68.46 | 53.21 | 71.55 | 47.75 | 65.35 | 60.87 | 61.2 | 56.61 | |
| Qwen2.5-VLModel Category=Open-source Offline Models, Model Scale=7B2026.03 | 67.79 | 55.05 | 67.24 | 42.13 | 66.34 | 60.87 | 59.9 | 52.28 | |
| LLaVA-OneVision-7B# Frames=642026.03 | 67.1 | 58.7 | 69.8 | 49.4 | 71.3 | 60.3 | 62.8 | — | |
| LLaVA-OneVisionParams=7B2026.05 | 67.1 | 58.7 | 69.8 | 49.4 | 71.3 | 60.3 | 62.8 | 52.9 | |
| Qwen2-VLModel Category=Open-source Offline Models, Model Scale=7B2026.03 | 60.4 | 50.46 | 56.03 | 47.19 | 66.34 | 55.43 | 55.98 | 51.22 | |
| DispiderModel Category=Open-source Online Models, Model Scale=7B2026.03 | 57.72 | 49.54 | 62.07 | 44.94 | 61.39 | 51.63 | 54.55 | 45.31 | |
| Dispider# Frames=1fps2026.03 | 57.7 | 49.5 | 62.1 | 44.9 | 61.4 | 51.6 | 54.5 | — | |
| DispiderParams=7B2026.05 | 57.7 | 49.5 | 62.1 | 44.9 | 61.4 | 51.6 | 54.5 | 41.8 | |
| LongVU-7B# Frames=1fps2026.03 | 55.7 | 49.5 | 59.5 | 48.3 | 68.3 | 63 | 57.4 | — | |
| LongVUParams=7B2026.05 | 55.7 | 49.5 | 59.5 | 48.3 | 68.3 | 63 | 57.4 | 48.5 | |
| LongVUModel Category=Open-source Offline Models, Model Scale=7B2026.03 | 53.69 | 53.21 | 62.93 | 47.75 | 68.32 | 59.78 | 57.61 | 46.31 | |
| Flash-VStream-7B# Frames=1fps2026.03 | 25.5 | 32.1 | 29.3 | 33.7 | 29.7 | 28.8 | 29.9 | — | |
| Flash-VstreamParams=7B2026.05 | 25.5 | 32.1 | 29.3 | 33.7 | 29.7 | 28.8 | 29.9 | 33.2 | |
| Flash-VStreamModel Category=Open-source Online Models, Model Scale=7B2026.03 | 24.16 | 29.36 | 28.45 | 33.71 | 25.74 | 28.8 | 28.37 | 27.88 | |
| VideoLLM-online-8B# Frames=2fps2026.03 | 8.1 | 23.9 | 12.1 | 14 | 45.5 | 21.2 | 20.8 | — | |
| VideoLLM-onlineParams=8B2026.05 | 8.1 | 23.9 | 12.1 | 14 | 45.5 | 21.2 | 20.8 | — | |
| VideoLLM-onlineModel Category=Open-source Online Models, Model Scale=8B2026.03 | 8.05 | 23.85 | 12.07 | 14.04 | 45.54 | 21.2 | 20.79 | 19.26 |