Streaming Evaluation on SVBench
57.99SA ScoreGPT-4o
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-4otype=Closed-source LVLM2026.06 | 57.99 | 63.52 | 67.72 | 60.18 | 59.25 | 59.97 | 61.27 | |
| GPT-4Vtype=Closed-source LVLM2026.06 | 56.37 | 61.41 | 65.8 | 59.18 | 57.16 | 57.93 | 59.12 | |
| LiveStarfine-tuning on the SVBench training set=true2026.06 | 52.19 | 59 | 62.85 | 58.35 | 54.95 | 55.87 | 57.41 | |
| Qwen2.5-VLtype=Open-source Video-LLM2026.06 | 48.21 | 56.12 | 60.31 | 56.33 | 52.46 | 52.84 | 55.21 | |
| MiniCPM-V 2.6type=Open-source Video-LLM2026.06 | 46.44 | 52.73 | 58.35 | 53.48 | 48.32 | 49.67 | 53.15 | |
| LiveStarProtype=Online Assistant2026.06 | 44.33 | 55.49 | 59.83 | 52.87 | 50.48 | 50.68 | 52.2 | |
| LiveStartype=Online Assistant2026.06 | 43.56 | 51.52 | 55.71 | 50.79 | 47.77 | 48.15 | 49.76 | |
| InternVideo2.5type=Open-source Video-LLM2026.06 | 41.76 | 49.72 | 53.25 | 48.44 | 47.1 | 46.58 | 49.16 | |
| InternVL2.5type=Open-source Video-LLM2026.06 | 40.44 | 48.34 | 52.84 | 46.93 | 45.1 | 45.04 | 46.89 | |
| LLaVA-NeXT-Videotype=Open-source Video-LLM2026.06 | 34.29 | 39.68 | 47.65 | 35.33 | 36.68 | 36.12 | 38.76 |