Visual-Only Question Answering on StreamingBench Visual-Only QA 1.0 (test)
92.6OPStreamOV
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| StreamOVAudio=true2026.05 | 92.6 | 87.5 | 95 | 90.5 | 85.7 | 94.7 | 88 | 80 | 86.1 | 44.6 | 86.2 | |
| Qwen3-VL-30B-A3BAudio=false2026.05 | 83.7 | 80.5 | 91.2 | 87.3 | 78.3 | 83.2 | 86.1 | 69.9 | 69.1 | 44 | 78.1 | |
| StreamForest-7BAudio=false2026.05 | 83.1 | 82.8 | 82.7 | 84.3 | 77.5 | 78.2 | 76.9 | 69.1 | 75.6 | 54.4 | 77.3 | |
| Qwen3-Omni-30B-A3BAudio=true2026.05 | 81.5 | 81.3 | 89.9 | 85 | 77.6 | 83.8 | 87 | 69.5 | 73.7 | 42 | 77.9 | |
| Qwen2.5-Omni-7BAudio=true2026.05 | 80.4 | 79.7 | 81.4 | 80.7 | 76.4 | 81.9 | 83.3 | 68.3 | 66 | 43.5 | 74.5 | |
| TimeChat-Online-7BAudio=false2026.05 | 80.2 | 82 | 79.5 | 83.3 | 76.1 | 78.5 | 78.7 | 64.6 | 69.6 | 58 | 75.4 | |
| Qwen2.5-VL-7BAudio=false2026.05 | 79 | 78.1 | 83.9 | 82.7 | 74.5 | 79.8 | 82.4 | 67.1 | 67.4 | 44 | 74.5 | |
| ROMA-7BAudio=true2026.05 | 77 | 78.1 | 77.9 | 82.1 | 74.8 | 72.9 | 82.4 | 61.8 | 65.9 | 51.1 | 72.4 | |
| Dispider-7BAudio=false2026.05 | 74.9 | 75.5 | 74.1 | 73.1 | 74.4 | 59.9 | 76.1 | 62.9 | 62.2 | 45.8 | 67.6 | |
| VideoLLM-online-8BAudio=false2026.05 | 39.1 | 40.1 | 34.5 | 31.1 | 46 | 32.4 | 31.5 | 34.2 | 42.5 | 27.9 | 36 | |
| Flash-VStream-7BAudio=false2026.05 | 25.9 | 43.6 | 24.9 | 23.9 | 27.3 | 13.1 | 18.5 | 25.2 | 23.9 | 48.7 | 23.2 |