Real-time Visual Perception on OVO-Bench Reactive QA 1.0 (test)
65.1OCRROMA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ROMAPositive loss weight (wpos)=42026.01 | 65.1 | 54.13 | 68.97 | 38.2 | 70.3 | 61.41 | |
| ROMAPositive loss weight (wpos)=22026.01 | 64.43 | 51.38 | 68.97 | 39.33 | 64.36 | 60.87 | |
| ROMA2026.01 | 63.09 | 53.21 | 68.1 | 39.33 | 69.31 | 58.15 | |
| ROMATraining strategy=Mixed Training2026.01 | 63.09 | 55.05 | 63.79 | 37.64 | 61.39 | 55.43 | |
| ROMAAggregation layers (K)=12026.01 | 61.47 | 55.05 | 68.1 | 39.89 | 65.35 | 60.33 | |
| ROMAArchitecture configuration (Speak Head)=Without Speak Head2026.01 | 61.07 | 55.05 | 63.97 | 39.89 | 65.35 | 54.89 | |
| Dispider2026.01 | 57.72 | 49.54 | 62.07 | 44.94 | 61.39 | 51.63 | |
| Flash-VStream-7B2026.01 | 24.16 | 29.36 | 28.45 | 33.71 | 25.74 | 28.8 | |
| MMDuet2026.01 | 13.42 | 11.93 | 14.66 | 11.8 | 14.85 | 10.33 | |
| VideoLLM-online2026.01 | 8.05 | 23.85 | 12.07 | 14.04 | 45.54 | 21.2 |