Proactive Monitoring on IPIBench
5.91TimingFlash-VStream-7B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Flash-VStream-7BModel Type=Open-source, Inference Mode=Online2026.05 | 5.91 | 0 | 0 | 1.97 | |
| LLaVA-OneVision-7BModel Type=Open-source, Inference Mode=Offline2026.05 | 12.14 | 8.66 | 0 | 6.93 | |
| VideoLLM-online-8BModel Type=Open-source, Inference Mode=Online2026.05 | 14.63 | 0.14 | 1.82 | 5.53 | |
| DispiderModel Type=Open-source, Inference Mode=Online2026.05 | 18.72 | 0.65 | 1.82 | 7.06 | |
| InternVL3-8BModel Type=Open-source, Inference Mode=Offline2026.05 | 32.51 | 22.31 | 3.77 | 19.53 | |
| Qwen3.5-PlusModel Type=Open-source, Inference Mode=Offline2026.05 | 35.25 | 24.35 | 7.89 | 22.5 | |
| Qwen3-VL-8BModel Type=Open-source, Inference Mode=Offline2026.05 | 43.12 | 24.51 | 4.25 | 23.96 | |
| Gemini 3 ProModel Type=Proprietary, Inference Mode=Offline2026.05 | 43.49 | 24.9 | 18.4 | 28.93 | |
| Gemini 2.5 ProModel Type=Proprietary, Inference Mode=Offline2026.05 | 45.36 | 25.26 | 13.21 | 27.94 | |
| GLM-4.6VModel Type=Open-source, Inference Mode=Offline2026.05 | 50.43 | 27.59 | 10.85 | 29.62 | |
| GPT-4oModel Type=Proprietary, Inference Mode=Offline2026.05 | 50.59 | 25.99 | 13.68 | 30.09 | |
| GPT-5.4Model Type=Proprietary, Inference Mode=Offline2026.05 | 54.64 | 23.52 | 8.96 | 29.04 | |
| Human Level2026.05 | 98 | 94 | 92 | 94.67 |