Online VideoQA on StreamingBench 1.0 (test)
82.9Real-Time ScoreGemini-3-Flash
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-Flash#Frames=12026.04 | 82.9 | 57.1 | 68.1 | |
| Qwen3-VL#Frames=4, Model Size=8B2026.04 | 79.6 | 67.2 | 62.9 | |
| Qwen2.5-VL#Frames=4, Model Size=7B2026.04 | 79 | 64.6 | 56.9 | |
| StreamForest#Frames=1fps, Model Size=7B2026.04 | 77.3 | — | — | |
| StreamBridge#Frames=1fps, Model Size=7B2026.04 | 77 | 24.1 | 32.6 | |
| Qwen3-VL#Frames=1, Model Size=8B2026.04 | 76 | 52.1 | 59.2 | |
| Qwen2.5-VL#Frames=1, Model Size=7B2026.04 | 75.5 | 48.4 | 53.6 | |
| Timechat-Online#Frames=1fps, Model Size=7B2026.04 | 75.4 | 37.8 | 35.3 | |
| StreamAgent#Frames=1fps, Model Size=7B2026.04 | 74.3 | 36.3 | 34.6 | |
| GPT-5#Frames=12026.04 | 74 | 52.7 | 56.9 | |
| Gemini-3-Flash#Frames=02026.04 | 59.8 | 34.8 | 29 | |
| GPT-5#Frames=02026.04 | 58.2 | 36.6 | 27.8 | |
| Qwen2.5-VL#Frames=0, Model Size=7B2026.04 | 52.5 | 32.7 | 21.8 | |
| Qwen3-VL#Frames=0, Model Size=8B2026.04 | 48.7 | 32.5 | 24.6 |