Streaming Video Understanding on StreamBench
54.9AccuracyQwen2.5-VL-7B
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-VL-7BMode=Traditional Streaming Prefill (Baseline), acn=∞, ur=∞, s=–2026.06 | 54.9 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=4, ur=64, s=0.25 (↓48.0%)2026.06 | 54.07 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=8, ur=64, s=0.25 (↓48.4%)2026.06 | 53.68 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=4, ur=32, s=0.25 (↓48.0%)2026.06 | 53.51 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=8, ur=32, s=0.25 (↓48.4%)2026.06 | 53.51 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=4, ur=64, s=0.1 (↓70.6%)2026.06 | 51.01 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=8, ur=64, s=0.1 (↓70.5%)2026.06 | 50.97 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=4, ur=32, s=0.1 (↓70.6%)2026.06 | 50.53 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-7B, acn=8, ur=32, s=0.1 (↓70.5%)2026.06 | 50.42 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=4, ur=32, s=0.25 (↓57.6%)2026.06 | 49.94 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=4, ur=64, s=0.25 (↓57.6%)2026.06 | 49.72 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=8, ur=32, s=0.25 (↓57.3%)2026.06 | 49.14 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=8, ur=64, s=0.25 (↓57.3%)2026.06 | 49.06 | — | — | — | — | — | — | — | |
| Qwen2.5-VL-3BMode=Traditional Streaming Prefill (Baseline), acn=∞, ur=∞, s=–2026.06 | 48.37 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=8, ur=32, s=0.1 (↓72.9%)2026.06 | 47.66 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=8, ur=64, s=0.1 (↓73.0%)2026.06 | 47.52 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=4, ur=64, s=0.1 (↓72.9%)2026.06 | 46.35 | — | — | — | — | — | — | — | |
| ViCoStreamBackbone=Qwen2.5-VL-3B, acn=4, ur=32, s=0.1 (↓72.9%)2026.06 | 46.09 | — | — | — | — | — | — | — | |
| Flash-VStreamframes=1 fps2026.04 | — | 37.1 | 44.5 | 48.6 | 58.1 | 66.4 | 59.2 | 52.1 | |
| FreeVAframes=42026.04 | — | 35.6 | 37.5 | 43.7 | 58.8 | 84 | 53.7 | 56.3 | |
| GPT-4oframes=502026.04 | — | 60.5 | 61.2 | 64.4 | 72.3 | 93.9 | 74.7 | 71 | |
| InternLM-XCP2.5frames=82026.04 | — | 38.8 | 43.3 | 50.8 | 65.6 | 88.4 | 60.5 | 57.7 | |
| InternVL-V2frames=82026.04 | — | 38.5 | 46.6 | 50.9 | 67.6 | 81 | 62.2 | 57.6 | |
| LLaMA-VIDframes=1802026.04 | — | 33.9 | 38.2 | 44.1 | 58.4 | 76.9 | 57.1 | 51.2 | |
| LLaVA-Houndframes=82026.04 | — | 37.6 | 43.2 | 53.4 | 55.7 | 76.3 | 62 | 54.7 | |
| LongVAframes=82026.04 | — | 41.1 | 47.4 | 57.6 | 59.8 | 80.7 | 66.1 | 52.4 | |
| MiniCMP-v2.6frames=82026.04 | — | 37.6 | 51.9 | 43.7 | 65.7 | 66.2 | 64.2 | 56.6 | |
| MovieChatframes=322026.04 | — | 18.6 | 20.4 | 26.5 | 42.3 | 67.2 | 35.8 | 35.3 | |
| Qwen2.5-VL-7Bframes=0.5 fps2026.04 | — | 36.1 | 41.3 | 41 | 50.5 | 76.5 | 62.3 | 51.1 | |
| Qwen2.5-VL-7B + OASISframes=-2026.04 | — | 35.9 | 39.4 | 44.1 | 54.5 | 76.9 | 64.9 | 52.4 | |
| Qwen3-VL-8Bframes=0.5 fps2026.04 | — | 33.8 | 50.5 | 47.8 | 69.4 | 73.5 | 62.6 | 56 | |
| Qwen3-VL-8B + OASISframes=-2026.04 | — | 47 | 53.6 | 54.3 | 71.7 | 86.1 | 67.6 | 62.1 | |
| StreamChatframes=15 fps2026.04 | — | 40.7 | 43.6 | 47.1 | 63 | 89.1 | 73.8 | 59.5 | |
| Video-onlineframes=5 fps2026.04 | — | 41.4 | 48.8 | 52.9 | 62.7 | 69.2 | 64.1 | 56.4 | |
| VILA-1.5frames=82026.04 | — | 36.1 | 44.4 | 50.8 | 68.3 | 78.6 | 65.5 | 57.1 |