Streaming Video Understanding on PEARL-Bench
97.61Frame-level Real-Time PerformanceHuman
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human#Frames=-2026.03 | 97.61 | 96.45 | 97.03 | 97.49 | |
| Qwen3-VL-8B+PEARL#Frames=1fps2026.03 | 54.99 | 49.49 | 52.24 | 48.39 | |
| Gemini3-pro-preview#Frames=642026.03 | 47.4 | 48.98 | 48.19 | 24.51 | |
| LLava-OV-7B+PEARL#Frames=1fps2026.03 | 33.41 | 42.64 | 38.03 | 19.94 | |
| Qwen2-VL-7B+PEARL#Frames=1fps2026.03 | 33.3 | 44.42 | 38.86 | 24.34 | |
| TimeChat-Online-7B#Frames=1fps2026.03 | 31.89 | 35.28 | 33.59 | 22.29 | |
| InternVL3.5-8B#Frames=642026.03 | 30.35 | 35.06 | 32.71 | 5.57 | |
| StreamForest-7B#Frames=1fps2026.03 | 29.18 | 40.86 | 35.02 | 10.85 | |
| Qwen3-VL-8B (Offline)#Frames=642026.03 | 27.33 | 30.2 | 28.77 | 25.51 | |
| ReKV(LLava-OV-7B)#Frames=0.5fps2026.03 | 26.2 | 37.46 | 31.83 | 24.11 | |
| LLava-OV-7B#Frames=642026.03 | 24.95 | 34.01 | 29.48 | 10.86 | |
| Qwen2-VL-7B#Frames=642026.03 | 23.21 | 35.79 | 29.5 | 17.89 | |
| Qwen3-VL-8B (Text-only)#Frames=-2026.03 | 11.06 | 17.45 | 14.26 | 7.04 |