Proactive Alerting on OmniMMI
65.24PrecisionProAct-Stream
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ProAct-StreamTraining Strategy=SFT, Backbone=Qwen3VL-8B, Evaluation Protocol=Streaming frame-by-frame2026.05 | 65.24 | 71.94 | 62.85 | 96.92 | 51.05 | |
| Qwen2.5VL-72BEvaluation Protocol=Streaming frame-by-frame2026.05 | 62.13 | 51.45 | 50.93 | 90.25 | 42.22 | |
| Qwen3VL-8bEvaluation Protocol=Streaming frame-by-frame2026.05 | 58.12 | 59.58 | 52.82 | 89.67 | 44.43 | |
| Qwen3VL-4BEvaluation Protocol=Streaming frame-by-frame2026.05 | 54.25 | 70.81 | 55.94 | 90.5 | 45.83 | |
| Qwen3VL-30B-A3BEvaluation Protocol=Streaming frame-by-frame2026.05 | 39.77 | 28.99 | 30.37 | 79.58 | 24.97 | |
| Qwen2.5VL-32BEvaluation Protocol=Streaming frame-by-frame2026.05 | 34.99 | 20.89 | 23.65 | 76.5 | 19.35 | |
| VideoChat-R1.5Evaluation Protocol=Streaming frame-by-frame2026.05 | 33.01 | 44.48 | 32.71 | 78.25 | 26.47 | |
| Qwen2.5VL-7BEvaluation Protocol=Streaming frame-by-frame2026.05 | 14.06 | 30.5 | 16.29 | 68.67 | 12.47 | |
| VideoRFT-7BEvaluation Protocol=Streaming frame-by-frame2026.05 | 6.86 | 33.32 | 10.32 | 63 | 6.58 | |
| TimeChatOnline-7BEvaluation Protocol=Streaming frame-by-frame2026.05 | 3.89 | 15.25 | 5.6 | 65.08 | 3.77 | |
| Qwen2.5vl-3BEvaluation Protocol=Streaming frame-by-frame2026.05 | 1.72 | 5.05 | 2.15 | 64.17 | 1.49 |