Real-time Visual Understanding on StreamingBench
91.46Overall ScoreHuman
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HumanParams=-, Frames=-2026.02 | 91.46 | 89.47 | 92 | 93.6 | 91.47 | 95.65 | 92.52 | 88 | 88.75 | 89.74 | 91.3 | |
| Human# Frames=-2026.03 | 91.46 | 89.47 | 92 | 93.6 | 91.47 | 95.65 | 92.52 | 88 | 88.75 | 89.74 | 91.3 | |
| Human#Frames=-, RGB (%)=-2026.03 | 91.46 | 89.47 | 92 | 93.6 | 91.47 | 95.65 | 92.52 | 88 | 88.75 | 89.74 | 91.3 | |
| Human# of Frames=-2026.03 | 91.46 | 89.47 | 92 | 93.6 | 91.47 | 95.65 | 92.52 | 88 | 88.75 | 89.74 | 91.3 | |
| Human#Frames=–2026.04 | 91.46 | — | — | — | — | — | — | — | — | — | — | |
| HumanSize=–, Frames=–, Pub=–2026.04 | 91.46 | 89.47 | 92 | 93.6 | 91.47 | 95.65 | 92.52 | 88 | 88.75 | 89.74 | 91.3 | |
| Human2025.08 | 91.46 | 89.47 | 92 | 93.6 | 91.47 | 95.65 | 92.52 | 88 | 88.75 | 89.74 | 91.3 | |
| SIMPLESTREAM (Qwen3-VL-8B + 4f)#Frames=42026.04 | 80.59 | — | — | — | — | — | — | — | — | — | — | |
| HERMES-7B†#Frames=1 fps, Memory Budget=4K tokens2026.04 | 79.44 | — | — | — | — | — | — | — | — | — | — | |
| SIMPLESTREAM (Qwen2.5-VL-7B + 8f)#Frames=82026.04 | 79.11 | — | — | — | — | — | — | — | — | — | — | |
| SIMPLESTREAM (Qwen3-VL-8B + 8f)#Frames=82026.04 | 78.83 | — | — | — | — | — | — | — | — | — | — | |
| SIMPLESTREAM (Qwen2.5-VL-7B + 4f)#Frames=42026.04 | 78.47 | — | — | — | — | — | — | — | — | — | — | |
| SIMPLESTREAM (Qwen3-VL-8B + 2f)#Frames=22026.04 | 78.31 | — | — | — | — | — | — | — | — | — | — | |
| WAT# Frames=1 fps2026.03 | 77.7 | 82.93 | 78.91 | 85.49 | 84.24 | 76.58 | 83.8 | 83.33 | 73.17 | 72.44 | 45.74 | |
| StreamForestParams=7B, Frames=1 fps2026.02 | 77.26 | 83.11 | 82.81 | 82.65 | 84.26 | 77.5 | 78.19 | 76.85 | 69.11 | 75.64 | 54.4 | |
| StreamForest-7B#Frames=1 fps2026.04 | 77.26 | — | — | — | — | — | — | — | — | — | — | |
| InternVL-3.5-8B#Frames=128, RGB (%)=1002026.03 | 77.2 | 83.47 | 82.03 | 82.65 | 84.62 | 75.47 | 80.06 | 81.48 | 67.89 | 70.45 | 59.04 | |
| EventMemAgentParams=8B, Frames=≤322026.02 | 77 | 83.92 | 76.56 | 87.7 | 85.29 | 77.02 | 79.44 | 77.78 | 68.29 | 72.24 | 48.7 | |
| SIMPLESTREAM (Qwen2.5-VL-7B + 2f)#Frames=22026.04 | 76.39 | — | — | — | — | — | — | — | — | — | — | |
| Gemini 1.5 proParams=-, Frames=1 fps2026.02 | 75.69 | 79.02 | 80.47 | 83.54 | 79.67 | 80 | 84.74 | 77.78 | 64.23 | 71.95 | 48.7 | |
| Gemini 1.5 pro# Frames=1 fps2026.03 | 75.69 | 79.02 | 80.47 | 83.54 | 79.67 | 80 | 84.74 | 77.78 | 64.23 | 71.95 | 48.7 | |
| Gemini 1.5 Pro#Frames=1 fps, RGB (%)=1002026.03 | 75.69 | 79.02 | 80.47 | 83.54 | 79.67 | 80 | 84.74 | 77.78 | 64.23 | 71.95 | 48.7 | |
| Gemini 1.5 pro# of Frames=1 FPS2026.03 | 75.69 | 79.02 | 80.47 | 83.54 | 79.67 | 80 | 84.74 | 77.78 | 64.23 | 71.95 | 48.7 | |
| Gemini 1.5 ProSize=–, Frames=1 fps, Pub=–2026.04 | 75.69 | 79.02 | 80.47 | 83.54 | 79.67 | 80 | 84.74 | 77.78 | 64.23 | 71.95 | 48.7 | |
| Gemini 1.5 proFrames=1 fps2025.08 | 75.69 | 79.02 | 80.47 | 83.54 | 79.67 | 80 | 84.74 | 77.78 | 64.23 | 71.95 | 48.7 | |
| TimeChat-OnlineParams=7B, Frames=1 fps2026.02 | 75.36 | 80.22 | 82.03 | 79.5 | 83.33 | 76.1 | 78.5 | 78.7 | 64.63 | 69.6 | 57.98 | |
| TimeChat-Online-7B# Frames=1 fps2026.03 | 75.36 | 80.22 | 82.03 | 79.5 | 83.33 | 76.1 | 78.5 | 78.7 | 64.63 | 69.6 | 57.98 | |
| TimeChat-Online-7B#Frames=1 fps, RGB (%)=1002026.03 | 75.36 | 80.22 | 82.03 | 79.5 | 83.33 | 76.1 | 78.5 | 78.7 | 64.63 | 69.6 | 57.98 | |
| TimeChat-Online-7B# of Frames=1 FPS2026.03 | 75.28 | 80.8 | 79.7 | 80.8 | 83.3 | 74.8 | 78.8 | 78.7 | 64.2 | 68.8 | 58 | |
| TimeChat-Online-7B#Frames=1 fps2026.04 | 75.28 | — | — | — | — | — | — | — | — | — | — | |
| ColorTrigger#Frames=128, RGB (%)=34.3 (↓ 65.7%)2026.03 | 75.24 | 81.57 | 78.91 | 77.29 | 84.94 | 76.1 | 77.57 | 81.48 | 67.48 | 67.61 | 56.91 | |
| StreamAgent# of Frames=1 FPS2026.03 | 74.31 | 79.63 | 78.31 | 79.28 | 75.87 | 74.74 | 76.92 | 82.94 | 66.31 | 73.69 | 55.4 | |
| StreamAgentParams=7B, Frames=1fps2026.02 | 74.28 | 79.63 | 78.31 | 79.28 | 75.87 | 74.74 | 76.92 | 82.94 | 66.31 | 73.69 | 55.4 | |
| StreamAgentParams=7B, Frames=1 fps2025.08 | 74.28 | 79.63 | 78.31 | 79.28 | 75.87 | 74.74 | 76.92 | 82.94 | 66.31 | 73.69 | 55.4 | |
| Qwen3-VL-8B + STRIDE# of Frames=1 FPS2026.03 | 74.24 | 77.1 | 75 | 77.3 | 72.8 | 76.4 | 77.9 | 76.9 | 69.9 | 84.3 | 46.1 | |
| QueryStream-7B# of Frames=1 FPS2026.03 | 74.04 | 82.11 | 83.59 | 78.23 | 82.69 | 75.47 | 80.06 | 79.63 | 63.01 | 67.9 | 42.55 | |
| Qwen3-VL-8B + Baseline-AR# of Frames=1 FPS2026.03 | 73.79 | 79 | 72.7 | 85.5 | 70.8 | 73.3 | 76.6 | 81.5 | 63.4 | 80.7 | 44.6 | |
| Qwen2.5-VL-7B# Frames=1 fps2026.03 | 73.68 | 78.32 | 80.47 | 78.86 | 80.45 | 76.73 | 78.5 | 79.63 | 63.41 | 66.19 | 53.19 | |
| Qwen2.5-VL-7B#Frames=1 fps, RGB (%)=1002026.03 | 73.68 | 78.32 | 80.47 | 78.86 | 80.45 | 76.73 | 78.5 | 79.63 | 63.41 | 66.19 | 53.19 | |
| Qwen2.5-VLSize=7B, Frames=1 fps, Pub=ARXIV242026.04 | 73.68 | 78.32 | 80.47 | 78.86 | 80.45 | 76.73 | 78.5 | 79.63 | 63.41 | 66.19 | 53.19 | |
| Qwen2.5-VL-7B#Frames=1 fps2026.04 | 73.31 | — | — | — | — | — | — | — | — | — | — | |
| GPT-4oParams=-, Frames=642026.02 | 73.28 | 77.11 | 80.47 | 83.91 | 76.47 | 70.19 | 83.8 | 66.67 | 62.19 | 69.12 | 49.22 | |
| GPT-4o# Frames=642026.03 | 73.28 | 77.11 | 80.47 | 83.91 | 76.47 | 70.19 | 83.8 | 66.67 | 62.19 | 69.12 | 49.22 | |
| GPT-4o#Frames=64, RGB (%)=1002026.03 | 73.28 | 77.11 | 80.47 | 83.91 | 76.47 | 70.19 | 83.8 | 66.67 | 62.19 | 69.12 | 49.22 | |
| GPT-4o# of Frames=642026.03 | 73.28 | 77.11 | 80.47 | 83.91 | 76.47 | 70.19 | 83.8 | 66.67 | 62.19 | 69.12 | 49.22 | |
| GPT-4oSize=–, Frames=64, Pub=–2026.04 | 73.28 | 77.11 | 80.47 | 83.91 | 76.47 | 70.19 | 83.8 | 66.67 | 62.19 | 69.12 | 49.22 | |
| GPT-4oFrames=642025.08 | 73.28 | 77.11 | 80.47 | 83.91 | 76.47 | 70.19 | 83.8 | 66.67 | 62.19 | 69.12 | 49.22 | |
| InternVL3-8B + STRIDE# of Frames=1 FPS2026.03 | 72.45 | 74.9 | 78.9 | 76.7 | 68.6 | 77 | 77.3 | 77.8 | 71.5 | 83 | 33.2 | |
| Claude 3.5 SonnetParams=-, Frames=202026.02 | 72.44 | 73.33 | 80.47 | 84.09 | 82.02 | 75.39 | 79.53 | 61.11 | 61.79 | 69.32 | 43.09 | |
| Claude 3.5 Sonnet# Frames=202026.03 | 72.44 | 73.33 | 80.47 | 84.09 | 82.02 | 75.39 | 79.53 | 61.11 | 61.79 | 69.32 | 43.09 | |
| Claude 3.5 Sonnet#Frames=20, RGB (%)=1002026.03 | 72.44 | 80.49 | 77.34 | 82.02 | 81.73 | 72.33 | 75.39 | 61.11 | 61.79 | 69.32 | 43.09 | |
| Claude 3.5 SonnetSize=–, Frames=20, Pub=–2026.04 | 72.44 | 73.33 | 80.47 | 84.09 | 82.02 | 75.39 | 79.53 | 61.11 | 61.79 | 69.32 | 43.09 | |
| Claude 3.5 SonnetFrames=202025.08 | 72.44 | 80.49 | 77.34 | 82.02 | 81.73 | 72.33 | 75.39 | 61.11 | 61.79 | 69.32 | 43.09 | |
| Thinking-QwenVLSize=7B, Frames=1 fps, Pub=–2026.04 | 71.6 | 70.27 | 66.67 | 80 | 77.97 | 79.31 | 68.66 | 78.26 | 68.18 | 72.31 | 52.38 | |
| LLaVA-OneVision-7B# Frames=322026.03 | 71.12 | 80.38 | 74.22 | 76.03 | 80.72 | 72.67 | 71.65 | 67.59 | 65.45 | 65.72 | 45.08 | |
| LLaVA-OneVision-7B#Frames=32, RGB (%)=1002026.03 | 71.12 | 80.38 | 74.22 | 76.03 | 80.72 | 72.67 | 71.65 | 67.59 | 65.45 | 65.72 | 45.08 | |
| LLaVA-OV-7B# of Frames=322026.03 | 71.12 | 80.38 | 74.22 | 76.03 | 80.72 | 72.67 | 71.65 | 67.59 | 65.45 | 65.72 | 45.08 | |
| LLaVA-OneVision-7B#Frames=322026.04 | 71.12 | — | — | — | — | — | — | — | — | — | — | |
| LLaVA-OneVisionSize=7B, Frames=32, Pub=CVPR252026.04 | 71.12 | 80.38 | 74.22 | 76.03 | 80.72 | 72.67 | 71.65 | 67.59 | 65.45 | 65.72 | 45.08 | |
| LLaVA-OneVisionParams=7B, Frames=322025.08 | 71.12 | 80.38 | 74.22 | 76.03 | 80.72 | 72.67 | 71.65 | 67.59 | 65.45 | 65.72 | 45.08 | |
| ColorTrigger#Frames=128, RGB (%)=8.1 (↓ 91.9%)2026.03 | 70.72 | 75.07 | 77.34 | 72.56 | 75.64 | 71.7 | 70.4 | 76.85 | 65.04 | 66.48 | 57.98 | |
| Qwen3-VLParams=8B, Frames=0.2-1 fps2026.02 | 70.2 | 73.57 | 71.09 | 76.34 | 80.39 | 65.22 | 74.77 | 78.7 | 67.89 | 61.47 | 47.67 | |
| Qwen2-VLParams=7B, Frames=0.2-1fps2026.02 | 69.04 | 75.2 | 77.45 | 73.19 | 82.81 | 68.32 | 71.03 | 72.22 | 61.19 | 61.47 | 46.11 | |
| Qwen2-VL-7B# of Frames=1 FPS2026.03 | 69.04 | 75.2 | 82.81 | 73.19 | 77.45 | 68.32 | 71.03 | 72.22 | 61.19 | 61.47 | 46.11 | |
| Qwen2-VL-7B#Frames=642026.04 | 69.04 | — | — | — | — | — | — | — | — | — | — | |
| Qwen2-VLParams=7B, Frames=0.2-1 fps2025.08 | 69.04 | 75.2 | 82.81 | 73.19 | 77.45 | 68.32 | 71.03 | 72.22 | 61.19 | 61.47 | 46.11 | |
| InternVL3-8B# of Frames=1 FPS2026.03 | 68.71 | 74.9 | 82 | 75.7 | 61.2 | 72 | 67.6 | 74.1 | 66.7 | 78.1 | 34.2 | |
| DispiderParams=7B, Frames=1 fps2026.02 | 67.63 | 74.92 | 75.53 | 74.1 | 73.08 | 74.44 | 59.92 | 76.14 | 62.91 | 62.16 | 45.8 | |
| Dispider-7B# Frames=1 fps2026.03 | 67.63 | 74.92 | 75.53 | 74.1 | 73.08 | 74.44 | 59.92 | 76.14 | 62.91 | 62.16 | 45.8 | |
| Dispider-7B#Frames=1 fps, RGB (%)=1002026.03 | 67.63 | 74.92 | 75.53 | 74.1 | 73.08 | 74.44 | 59.92 | 76.14 | 62.91 | 62.16 | 45.8 | |
| Dispider# of Frames=1 FPS2026.03 | 67.63 | 74.92 | 75.53 | 74.1 | 73.08 | 74.44 | 59.92 | 76.14 | 62.91 | 62.16 | 45.8 | |
| Dispider-7B#Frames=1 fps2026.04 | 67.63 | — | — | — | — | — | — | — | — | — | — | |
| DispiderSize=7B, Frames=1 fps, Pub=CVPR252026.04 | 67.63 | 74.92 | 75.53 | 74.1 | 73.08 | 74.44 | 59.92 | 76.14 | 62.91 | 62.16 | 45.8 | |
| DispiderParams=7B, Frames=1 fps2025.08 | 67.63 | 74.92 | 75.53 | 74.1 | 73.08 | 74.44 | 59.92 | 76.14 | 62.91 | 62.16 | 45.8 | |
| MiniCPM-V-2.6Params=8B, Frames=322026.02 | 67.44 | 71.93 | 71.09 | 77.92 | 75.82 | 64.6 | 65.73 | 70.37 | 56.1 | 62.32 | 53.37 | |
| MiniCPM-V-2.6-8B# Frames=322026.03 | 67.44 | 71.93 | 71.09 | 77.92 | 75.82 | 64.6 | 65.73 | 70.37 | 56.1 | 62.32 | 53.37 | |
| MiniCPM-V 2.6 8B# of Frames=322026.03 | 67.44 | 71.93 | 71.09 | 77.92 | 75.82 | 64.6 | 65.73 | 70.37 | 56.1 | 62.32 | 53.37 | |
| MiniCPM-V-2.6Size=8B, Frames=32, Pub=ARXIV252026.04 | 67.44 | 71.93 | 71.09 | 77.92 | 75.82 | 64.6 | 65.73 | 70.37 | 56.1 | 62.32 | 53.37 | |
| MiniCPM-V 2.6Params=8B, Frames=322025.08 | 67.44 | 71.93 | 71.09 | 77.92 | 75.82 | 64.6 | 65.73 | 70.37 | 56.1 | 62.32 | 53.37 | |
| LLaVA-NeXT-VideoParams=32B, Frames=642026.02 | 66.96 | 78.2 | 70.31 | 73.82 | 76.8 | 63.35 | 69.78 | 57.41 | 56.1 | 64.31 | 38.86 | |
| LLaVA-NeXT-Video-32B# Frames=642026.03 | 66.96 | 78.2 | 70.31 | 73.82 | 76.8 | 63.35 | 69.78 | 57.41 | 56.1 | 64.31 | 38.86 | |
| LLaVA-NeXT-VideoSize=32B, Frames=64, Pub=BLOG242026.04 | 66.96 | 78.2 | 70.31 | 73.82 | 76.8 | 63.35 | 69.78 | 57.41 | 56.1 | 64.31 | 38.86 | |
| LLaVA-NeXT-VideoParams=32B, Frames=642025.08 | 66.96 | 78.2 | 70.31 | 73.82 | 76.8 | 63.35 | 69.78 | 57.41 | 56.1 | 64.31 | 38.86 | |
| KangarooParams=7B, Frames=642026.02 | 64.6 | 71.12 | 84.38 | 70.66 | 73.2 | 67.08 | 61.68 | 56.48 | 55.69 | 62.04 | 38.86 | |
| Kangaroo-7B# Frames=642026.03 | 64.6 | 71.12 | 84.38 | 70.66 | 73.2 | 67.08 | 61.68 | 56.48 | 55.69 | 62.04 | 38.86 | |
| Kangaroo-7B# of Frames=642026.03 | 64.6 | 71.12 | 84.38 | 70.66 | 73.2 | 67.08 | 61.68 | 56.48 | 55.69 | 62.04 | 38.86 | |
| KangarooSize=7B, Frames=64, Pub=ARXIV242026.04 | 64.6 | 71.12 | 84.38 | 70.66 | 73.2 | 67.08 | 61.68 | 56.48 | 55.69 | 62.04 | 38.86 | |
| KangarooParams=7B, Frames=642025.08 | 64.6 | 71.12 | 84.38 | 70.66 | 73.2 | 67.08 | 61.68 | 56.48 | 55.69 | 62.04 | 38.86 | |
| InternVL-V2Params=8B, Frames=162026.02 | 63.72 | 68.12 | 60.94 | 69.4 | 77.12 | 67.7 | 62.93 | 59.26 | 53.25 | 54.96 | 56.48 | |
| InternVL-V2-8B# Frames=162026.03 | 63.72 | 68.12 | 60.94 | 69.4 | 77.12 | 67.7 | 62.93 | 59.26 | 53.25 | 54.96 | 56.48 | |
| InternVL-V2-8B# of Frames=162026.03 | 63.72 | 68.12 | 60.94 | 69.4 | 77.12 | 67.7 | 62.93 | 59.26 | 53.25 | 54.96 | 56.48 | |
| InternVL2-8B#Frames=162026.04 | 63.72 | — | — | — | — | — | — | — | — | — | — | |
| InternVL-V2Size=8B, Frames=16, Pub=ARXIV242026.04 | 63.72 | 68.12 | 60.94 | 69.4 | 77.12 | 67.7 | 62.93 | 59.26 | 53.25 | 54.96 | 56.48 | |
| InternVL-V2Params=8B, Frames=162025.08 | 63.72 | 68.12 | 60.94 | 69.4 | 77.12 | 67.7 | 62.93 | 59.26 | 53.25 | 54.96 | 56.48 | |
| InternVL-3.5-8B grayscale#Frames=128, RGB (%)=02026.03 | 62.08 | 60.98 | 78.91 | 60.88 | 55.45 | 65.41 | 63.24 | 75 | 60.16 | 62.22 | 55.85 | |
| Qwen3-VL-8B# of Frames=1 FPS2026.03 | 60.88 | 62.7 | 68 | 69.7 | 53.3 | 67.5 | 65.1 | 67.6 | 48 | 68 | 40.9 | |
| Gemma3-4B + STRIDE# of Frames=1 FPS2026.03 | 60 | 66.8 | 71.9 | 66.6 | 57.2 | 66.5 | 70.7 | 60.2 | 43.1 | 65 | 23.8 | |
| LongVAParams=7B, Frames=1282026.02 | 59.96 | 70.03 | 63.28 | 61.2 | 70.92 | 62.73 | 59.5 | 61.11 | 53.66 | 54.67 | 34.72 | |
| LongVA-7B# Frames=1282026.03 | 59.96 | 70.03 | 63.28 | 61.2 | 70.92 | 62.73 | 59.5 | 61.11 | 53.66 | 54.67 | 34.72 | |
| LongVA-7B# of Frames=1282026.03 | 59.96 | 70.03 | 63.28 | 61.2 | 70.92 | 62.73 | 59.5 | 61.11 | 53.66 | 54.67 | 34.72 |